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Abstract 

This  thesis  investigates  the  feasibility  of  using  Simulated  Annealing  (S  A)  in  structural 
optimisation  problems.  SA  is  an  optimisation  process  modeled  after  the  physical  process 
of  annealing.  It  is  under  development  in  many  branches  of  the  sciences,  mathematics,  and 
engineering.  Its  usefulness  depends  on  making  many  iterations  in  a  random  search  among 
the  feasible  values  of  the  variables  of  a  cost  function.  These  many  iterations  are  becoming 
more  practical  as  computers  become  more  powerful.  This  algorithm  differs  from  other 
random  search  methods  by  accepting  a  worse  solution  (less  optimal)  than  the  previous, 
with  a  probability  derived  from  a  Boltzmann  distribution.  The  probability  of  accepting  a 
worse  solution  starts  out  high,  and  decreases  as  the  iterations  progress.  This  allows  the 
algorithm  to  escape  from  a  local  optimum  and,  with  a  number  of  iterations  approaching 
infinity,  to  find  the  global  optimum. 

The  investigation  involves  solving  benchmark  structural  optimization  problems  with 
an  SA  algorithm,  and  comparing  its  solutions  to  the  solutions  found  by  four  other  opti¬ 
mizers.  The  primary  comparison  is  in  quality  of  solution.  However,  each  optimizer  has 
its  strengths,  and  an  effort  has  been  made  to  highlight  the  strengths  of  SA  in  structural 
optimization. 

Overall,  the  analysis  shows  that  SA  has  limited  applicability  in  structural  optimiza¬ 
tion.  Two  primary  factors  were  found  to  adversely  impact  the  performance  of  the  SA 
algorithm  in  these  problems.  These  factors  are  high  dimensionality,  and  high  levels  of  con¬ 
straint.  The  difficulty  involved  in  solving  these  problems  with  a  random  search  increases 
exponentially  with  the  number  of  dimensions.  This  limits  the  applicability  of  this  algo¬ 
rithm  to  problems  having  less  than  twenty  variables.  The  number,  and  non-linearity,  of 
the  constraints  also  have  an  appreciable  effect  on  the  success  of  the  algorithm.  A  Measure 
of  Complexity  was  created  to  quantify  the  combined  effect  of  dimensionality  and  level  of 
constraint.  This  measure  can  be  used  to  predict  the  applicability  of  the  SA  algorithm  in 
optimizing  a  given  system  of  non-linear  equations. 
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AN  INVESTIGATION  OF  SIMULATED  ANNEALING 


APPLIED  TO 

STRUCTURAL  OPTIMIZATION  PROBLEMS 

I.  Introduction 

1.1  Background  of  the  Problem 

1.1.1  Engineering  Optimization.  The  concept  of  optimization  in  engineering  appli¬ 
cations  is  centuries  old.  One  of  the  first  recorded  engineering  optimizations  was  by  Galileo 
Galilei,  when  he  found  the  strongest  cantilever  beam  in  bending  and  constant  shear  (Ka- 
mat,  1993:2).  Typically,  in  formulating  the  optimization  problem,  the  performance  of  a 
system  is  modeled  by  an  objective  function.  The  optimization  task  is  to  minimize  or  maxi¬ 
mize  the  value  of  the  objective  function  by  finding  optimal  values  of  the  decision  variables. 

1.1. 1.1  Gradient  Search.  Many  of  today’s  more  prevalent  optimization  meth¬ 
ods  depend  on  the  calculus,  developed  in  the  17th  century.  In  these  methods,  the  deriva¬ 
tives  of  the  objective  function  (with  respect  to  each  of  the  decision  variables)  are  set  to 
zero,  generating  a  set  of  simultaneous  equations.  These  simultaneous  equations  are  solved, 
yielding  the  values  of  the  decision  variables  at  the  stationary  point,  or  points  (Kamat, 
1993:3).  The  derivatives  of  the  objective  function  form  the  gradient  at  a  certain  point, 
so  this  process  may  be  termed  a  gradient  based  search.  In  a  variation  of  this  method, 
the  gradient  of  the  “surface”  at  a  chosen  point  in  the  feasible  region  is  found.  With  this 
information,  an  iterative  gradient  search  algorithm  can  proceed  from  the  chosen  point,  in 
a  direction  which  always  yields  an  improved  solution  at  the  next  step.  Some  potential 
difficulties  exist  with  a  gradient  search.  Computing  the  gradients  of  the  surface  requires 
many  calculations,  and  may  be  very  time  consuming.  The  search  algorithm  could  stall  at 
a  relative  minima  ( local  optimum),  rather  than  finding  the  overall  minimum  ( global  op¬ 
timum)  for  the  entire  system.  Also,  the  surface  being  searched  must  be  continuous.  In 
spite  of  these  potential  difficulties,  gradient  search  has  been  successfully  applied  to  many 
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optimisation  problems.  This  basic  process  identifies  the  stationary  points  (function  max¬ 
ima,  minima,  or  saddle  points)  in  an  unconstrained  optimisation.  In  this  case,  there  are 
no  restrictions  on  the  values  of  the  decision  variables. 

1.1. 1.2  Constrained  Optimization.  For  most  engineering  applications  where 
the  decision  variables  represent  physical  characteristics  (such  as  temperature,  pressure, 
length,  etc.),  there  are  physical  or  economic  constraints  on  the  values  of  the  decision  vari¬ 
ables.  The  constraints  may  be  inequalities,  equalities,  or  (upper/lower)  bounds  (also  called 
side  constraints).  These  constraints  can  be  met  in  the  optimization  process  by  forming 
the  augmented  Lagrangian  function.  In  forming  the  Lagrangian,  each  of  the  constraints 
is  assigned  a  weighting  variable  (Lagrange  multiplier)  and  the  augmented  function  is  a 
composite  of  the  objective  function  and  the  sum  of  the  weighted  constraints.  This  aug¬ 
mented  function  becomes  the  objective  function,  and  is  minimized  as  before,  including 
solving  for  the  values  of  the  multipliers.  The  use  of  multipliers  increases  the  number  of 
variables  (dimensionality)  of  the  problem,  and  so,  the  complexity  of  the  minimization. 
However,  the  Lagrange  multipliers  make  the  connection  between  the  objective  function 
and  constraints,  and  they  give  a  proportional  weight  to  the  relative  importance  of  each 
constraint.  These  methods  are  implemented  currently  in  structural  optimization  by  the 
steepest  descent,  conjugate  gradient,  sequential  quadratic/linear  programming,  or  feasible 
directions  methods  (Kamat,  1993:4). 

1.1.2  Numerical  Optimization  Methods.  With  the  advent  of  modem  digital  com¬ 
puters  numerical  methods  of  optimization  became  practical,  with  finite  element,  finite 
difference,  and  other  discrete  methods  of  optimization  coming  into  use  for  structural  opti¬ 
mization  (Venkayya,  1993:4).  Typically,  the  process  involves  five  steps: 

1)  find  a  feasible  solution 

2)  evaluate  the  solution 

3)  compare  the  new  solution  to  previous  solutions 

4)  accept  (or  reject)  the  new  solution 

5)  stop  when  some  final  stopping  criteria  is  met,  or  go  to  step  1. 
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1. 1.2.1  Limitations  of  Numerical  Optimization.  While  this  type  of  search 
seems  like  a  simple  process,  it  has  some  potential  pitfalls.  For  instance,  non-linear  systems 
may  have  more  than  one  optimal  solution.  This  could  lead  to  finding  a  local  optimum, 
rather  than  the  single  best  global  optimum  over  the  entire  search  space.  In  the  case  of 
finding  a  local  optimum,  the  particular  local  optimum  found  might  depend  on  which  initial 
feasible  solution  was  chosen. 

At  each  iteration,  the  method  used  for  finding  the  new  feasible  solution  may  be  the 
factor  which  has  the  greatest  effect  on  the  conduct  of  the  minimization,  and  perhaps  the 
quality  of  the  final  solution.  For  example,  making  a  random  perturbation  of  the  system  at 
each  iteration  is  a  very  simple  way  of  choosing  the  next  solution,  but  this  method  may  never 
find  the  optimum.  On  the  other  hand,  a  pure  gradient  search  may  lead  to  choosing  the 
first  local  optimum  encountered,  rather  than  the  global  optimum  (McLaughlin,  1989:26). 

The  most  appropriate  stopping  criteria  for  a  numerical  search  algorithm  depend  on 
the  nature  of  the  problem.  For  a  convex  objective  function  with  concave  constraints,  a 
unique  global  minimum  is  found  when  the  necessary  and  sufficient  conditions  are  met. 
For  non-convex  problems,  meeting  the  necessary  conditions  may  not  uniquely  solve  the 
problem  (Kamat,  1993:5).  Linear  approximations  of  the  non-linear  functions  can  simplify 
the  process,  but  then  the  overall  quality  of  the  solution  depends  on  the  quality  and  locality 
of  the  approximation. 

Numerical  search  techniques  are  especially  useful  because  of  their  generality.  How¬ 
ever,  for  problems  with  many  variables,  or  for  highly  non-linear  systems  where  convergence 
to  an  optimal  solution  is  questionable,  the  numerical  search  process  may  stall.  In  these 
cases,  potential  solutions  can  be  compared  to  optimality  criteria,  eliminating  solutions  that 
do  not  meet  the  necessary  conditions. 

1.1.3  Structural  Optimization  is  the  process  of  finding  the  best  structure  for  a  given 
task  (Vanderplaatz,  1984:1).  The  structure  has  to  meet  all  the  requirements,  as  well  as 
meeting  the  definition  for  being  the  “best.”  Being  best  may  involve  being  the  lightest,  or 
the  cheapest,  or  the  smallest.  In  the  case  of  modern  aircraft,  the  best  structure  is  often 
the  lightest. 
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Structural  optimisation  related  to  aircraft  design  is  normally  done  to  minimi**  weight . 
This  is  important  for  fuel  conservation,  and  allows  for  maximum  performance  of  the  aircraft 
as  a  whole.  In  nr  >st  current  applications  this  minimisation  is  accomplished  by  a  gradi¬ 
ent  search  of  the  objective  function  with  constraints  formed  into  a  Lagrangian  function. 
One  example  of  an  aircraft  structural  optimisation  system  is  the  Automated  Structural 
Optimisation  System  (ASTROS). 

ASTROS  is  a  structural  design  optimisation  program  being  developed  by  the  Flight 
Dynamics  Directorate  of  Wright  Laboratories.  ASTROS  includes  a  module  to  minimise 
the  weight  of  aircraft  components  while  meeting  all  strength  and  flexibility  requirements. 
The  primary  algorithm  in  the  minimization  module  forms  the  Lagrangian  of  the  objective 
function  and  constraints  and  uses  a  gradient  search  to  solve  this  as  an  unconstrained 
minimization  (Canfield  and  Venkayya,  1990:1038).  First,  the  system  is  solved  for  the  values 
of  the  Lagrange  multipliers.  As  mentioned,  the  minimization  process  involves  finding  the 
derivatives  of  the  active  constraints.  However,  if  the  value  of  a  Lagrange  multiplier  is 
zero,  then  the  corresponding  constraint  has  no  “weight”  (is  not  active),  and  the  algorithm 
can  save  time  by  not  calculating  the  derivative  of  the  constraint.  However,  finding  the 
derivatives  of  the  active  constraints  can  be  time  consuming  (Canfield,  1993).  For  large, 
fully  constrained  problems,  this  may  overwhelm  even  a  supercomputer.  Several  approaches 
have  been  tried  to  overcome  this  problem,  but  none  is  completely  satisfactory  for  these 
large,  fully  constrained  problems  (Canfield  and  Venkayya,  1990:1037). 

1. 1.4  Simulated  Annealing  (S  A)  is  an  optimization  process  that  does  not  use  deriva¬ 
tives  in  minimizing  a  function.  For  this  reason,  SA  may  be  useful  in  structural  optimization 
to  solve  some  problems  which  cannot  be  solved  using  a  gradient  search  approach. 

SA  is  a  fairly  new  process  for  numerical  optimization  of  many  classes  of  problems.  It 
is  modeled  after  the  centuries-old  annealing  process  for  metal  and  glass  castings.  Manufac¬ 
turers  anneal  castings  to  make  them  tougher,  by  reducing  their  internal  energy  (McLaugh¬ 
lin,  1989:28).  There  are  strong  parallels  between  Simulated  Annealing  and  the  physical 
process  of  annealing.  In  each  case,  a  system  of  many  variables  is  minimized. 
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SA  uses  many  steps  in  a  random  search  to  find  the  optimum  of  the  system.  Other 
random  search  algorithms  are  prone  to  selecting  the  first  local  optimum  encountered.  How¬ 
ever,  SA  has  a  feature  that  helps  it  find  the  global  optimum  rather  than  a  local  optimum. 
The  many  steps  required  in  SA  are  possible  with  modern  computers,  and  the  more  capable 
computers  become,  the  more  useful  SA  will  be. 

1.2  Conduct  of  the  Research 

1.2.1  Purpose  of  the  Research.  This  research  investigates  the  advantages  and  dis¬ 
advantages  of  applying  SA  to  structural  optimization  problems.  It  highlights  the  areas 
where  SA  shows  potential  for  further  use  in  structural  optimization.  The  results  of  this 
investigation  can  be  used  to  determine  if  further  work  should  be  done  to  implement  SA  in 
specific  structural  optimization  packages  by  commercial  and  government  users. 

1.2.2  Problem  Statement,  '’’he  problem  posed  for  this  research  is  to  implement  SA 
in  benchmark  structural  optimization  problems,  and  analyze  the  performance  of  SA  in  this 
application.  The  analysis  will  identify  strengths  and  weaknesses  of  SA  in  this  application 
and  provide  guidance  to  potential  users  concerning  the  applicability  of  SA  to  structural 
optimization  problems. 

1.2.3  Organization  of  the  Report.  This  thesis  consists  of  five  chapters,  beginning 
with  this  introductory  chapter.  Chapter  II  highlights  the  pertinent  structural  optimization 
and  SA  literature  that  has  been  published  to  date.  Chapter  m  outlines  the  theoretical 
background  and  development  of  SA  and  Adaptive  Simulated  Annealing,  as  well  as  ex¬ 
plaining  the  benchmarking  process  used  for  this  analysis.  In  Chapter  IV,  the  results  of 
optimizing  the  benchmark  problems  with  SA  and  analysis  of  these  results  are  shown.  Fi¬ 
nally,  Chapter  V  gives  a  summary,  recommendations  for  further  research,  and  conclusions 
of  the  investigation. 
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II.  Literature  Review 


2.1  Simulated  Annealing  ( SA )  in  Structural  Optimization 

While  no  direct  applications  of  simulated  annealing  to  structural  optimisation  have 
appeared  in  the  literature  yet,  SA  has  been  applied  in  a  wide  variety  of  other  contexts. 
The  SA  algorithm  has  been  developed  over  the  last  twenty  years  by  integrating  proven 
techniques  from  statistical  mechanics  with  new  insights  into  combinatorial  optimisation. 
Kirkpatrick,  et.al.,  brought  SA  to  the  attention  of  scientists  in  many  fields  when  they 
published  Optimization  by  Simulated  Annealing  (Kirkpatrick,  Gelatt,  and  Vecchi,  1983). 
Prior  to  this,  SA  was  an  obscure  mathematical  tool,  and  its  applicability  to  other  fields  was 
not  widely  recognised  (Collins,  Eglese,  and  Golden,  1988).  Kirkpatrick’s  article  becar 
launching  point  for  many  investigations  into  the  use  of  SA  in  fields  as  diverse  as  con. 
architecture,  geology,  chemistry,  and  biology. 

Kirkpatrick,  et.al,  identified  the  connection  between  statistical  mechanics  and  combi¬ 
natorial  optimization.  They  explained  that  in  annealing,  statistical  mechanics  models  the 
minimization  of  the  internal  energy  (heat)  of  many  molecules.  Combinatorial  optimization 
minimizes  (or  maximizes)  the  value  of  an  objective  function  of  many  variables.  They  gave 
examples  showing  how  statistical  mechanics  in  annealing  is  analogous  to  combinatorial 
optimization  in  designing  computer  chips  and  in  the  classic  traveling  salesman  problem. 

2.2  Outline  of  the  Standard  SA  Algorithm 

The  SA  algorithm  involves  six  fundamental  steps  (Aarts  and  Korst,  1990:12) 

1.  Choose  a  feasible  starting  point  and  temperature;  then  evaluate  the  objective 
function. 

2.  Randomly  perturb  the  system  by  changing  the  value  of  one  or  more  decision 
variables,  while  ensuring  that  their  values  remain  feasible. 

3.  Evaluate  the  objective  function  at  the  new  point. 

4.  Apply  the  acceptance  criteria  for  the  new  solution. 
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5.  Repeat  steps  1  through  4  until  the  system  is  stable,  then  reduce  the  temperature 
according  to  the  annealing  schedule. 

6.  Repeat  steps  1  through  5  until  the  final  stopping  criteria  is  met. 
g.S  Highlights  of  the  Algorithm 

(1)  The  first  step  in  the  algorithm  is  to  choose  a  starting  configuration  and  control 
parameter  (analogous  to  temperature  in  physical  annealing),  then  find  the  initial  value 
of  the  objective  function.  While  these  choices  of  starting  solution  and  temperature  are 
unique  to  each  application,  SA  is  normally  fairly  insensitive  to  the  starting  conditions.  In 
the  application  to  structural  optimisation,  this  step  establishes  the  initial  physical  charac¬ 
teristics  of  the  structural  components,  ensures  that  all  constraints  are  met,  and  determines 
the  initial  weight  of  the  structure. 

The  term  temperature  is  a  holdover  from  the  physical  process  of  annealing,  where  it 
refers  to  the  actual  heat  content  of  a  casting.  In  simulated  annealing,  temperature  is  a 
parameter  that  controls  the  probability  of  accepting  a  new  solution  that  is  “worse”  than 
the  old  one.  The  higher  the  temperature,  the  greater  the  chance  of  accepting  a  “worse” 
solution.  This  probability  of  accepting  a  worse  solution  is  the  feature  that  allows  SA  to 
leave  a  local  minimum  and  continue  to  search  for  the  global  minimnm.  McLaughlin  suggests 
that  the  initial  temperature  should  be  high  enough  that  virtually  any  feasible  solution  will 
be  accepted  (McLaughlin,  1989:32),  but  a  more  common  initial  target  acceptance  rate  is 
about  80  percent. 

(2)  The  second  step  in  the  algorithm  is  to  randomly  perturb  the  system.  In  explain¬ 
ing  combinatorial  optimization,  Kirkpatrick,  et.al.,  described  a  random  search  method  that 
accepts  only  lower  values  of  the  objective  function  at  each  iteration.  It  usually  gets  stuck  in 
the  local  minimum  closest  to  the  starting  point.  This  algorithm  is  often  called  the  Greedy 
Algorithm  because,  in  its  “greed”  to  find  any  optimum,  it  will  likely  miss  the  global  opti¬ 
mum  and  accept  a  local  instead  (McLaughlin,  1989:25).  In  1985,  Ceroy  presented  a  Monte 
Carlo  algorithm  to  find  approximate  solutions  to  the  traveling  salesman  problem.  “The  al¬ 
gorithm  generates  randomly  the  permutations  of  the  stations  of  the  traveling  salesman  trip, 
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with  probability  depending  on  the  length  of  the  corresponding  route”  (Ceray,  1985:41). 
This  offers  one  method  for  generating  random  perturbations  to  a  system.  In  structural 
optimisation,  this  step  corresponds  to  a  random  change  in  the  physical  dimension  of  one 
or  more  components. 

(3)  The  third  step  is  to  evaluate  the  new  solution.  The  specific  mechanics  of  this 
evaluation  depend  on  the  application.  For  structural  optimisation,  this  step  determines 
the  total  weight  of  the  structure  with  the  new  dimensions. 

(4)  In  the  fourth  step,  accept  or  reject  the  new  solution.  If  the  new  solution  gives 
a  lower  value  for  the  objective  function,  accept  it.  However,  if  the  new  solution  gives  a 
higher  value,  consider  accepting  it.  This  possibility  of  accepting  the  “worse”  solution  gives 
the  SA  algorithm  the  ability  to  leave  a  local  optimum,  and  continue  to  search  for  the  global 
optimum.  This  is  the  key  feature  that  sets  SA  apart  from  other  random  search  algorithms. 
From  statistical  mechanics,  Kirkpatrick,  et.al.,  described  the  Metropolis  procedure  to  over¬ 
come  the  Greedy  Algorithm’s  problem  of  stalling  at  a  local  optimum.  “The  Metropolis 
procedure  from  statistical  mechanics  provides  a  generalization  of  iterative  improvement  in 
which  controlled  uphill  steps  can  also  be  incorporated  in  the  search  for  a  better  solution” 
(Kirkpatrick,  Gelatt,  and  Vecchi,  1983:674).  This  makes  it  possible  for  the  algorithm  to 
climb  out  of  a  local  minimum  and  find  a  better  local  minimum,  or  the  global  minimum. 
Control  for  the  uphill  steps  is  given  by  the  Boltzmann  distribution  (Figure  2.1): 


where  Pr(E)  is  the  probability  of  accepting  the  uphill  step,  Z(T)  is  a  normalizing  factor 
depending  on  the  assigned  temperature  (T),  E  is  the  average  energy  level,  fan!  kB  is  the 
Boltzmann  constant.  The  value  of  kB  is  a  natural  constant,  determined  by  experimentation, 
which  adjusts  the  shape  of  the  Boltzmann  distribution  to  model  the  physical  annealing 
process.  It  normally  would  not  represent  a  valid  constant  in  the  SA  process,  but  a  different 
constant  may  be  appropriate.  For  a  given  change  in  temperature,  when  the  temperature 
is  high,  the  probability  of  accepting  an  uphill  step  is  high.  As  the  temperature  is  reduced, 
the  probability  of  accepting  the  uphill  step  is  reduced. 
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Figure  2. 1  The  Boltzmann  Distribution  at 
High  and  Low  Temperatures 


(5)  Tire  fifth  step  in  the  algorithm  is  to  iterate  at  a  given  temperature  and,  when  the 
system  is  at  a  stable  average  configuration  for  that  temperature,  reduce  the  temperature 
according  to  the  annealing  schedule.  This  schedule  for  reducing  the  temperature  is  critical 
to  the  success  of  either  real  or  simulated  annealing.  According  to  Ceray,  “Experiments 
. . .  are  done  by  careful  annealing,  first  melting  the  substance,  then  lowering  the  temperature 
slowly,  and  spending  a  long  time  at  temperatures  in  the  vicinity  of  the  freezing  point.  If 
this  is  not  done,  and  the  substance  is  allowed  to  get  out  of  equilibrium,  the  resulting  crystal 
will  have  many  defects”  (Cerny,  1985). 

Quenching  is  the  process  of  deliberately  reducing  the  temperature  quickly,  without 
allowing  the  substance  to  reach  equilibrium.  This  degenerates  the  SA  algorithm  to  an 
ordinary  random  search  like  the  Greedy  Algorithm.  In  annealing,  this  process  creates  a 
brittle  casting,  but  it  is  much  quicker,  and  in  some  cases  may  be  preferred  to  the  slow 
annealing  process.  Quenching  is  not  normally  used  in  SA.  To  get  the  lowest  possible 
cost  with  SA,  the  annealing  schedule  must  allow  the  system  to  reach  steady-state  at  each 
temperature.  On  the  other  hand,  spending  too  much  time  at  a  given  temperature  wastes 
computer  resources.  So,  the  annealing  schedule  must  allow  the  system  to  stabilize  before 
changing  temperature,  and  then  change  promptly. 

The  cooling  schedule  is  often  found  by  trial  and  error  (Brooks  and  Verdini,  1988:431). 
However,  Basu  and  Frazer  suggest  that  it  may  be  cost  effective  to  spend  up  to  80  percent  of 
the  total  CPU  time  to  establish  the  best  cooling  schedule  (Basu  and  Frazer,  1990).  Collins, 
et.al.,  listed  five  different  schemes  for  controlling  the  temperature,  T,  (Collins,  Eglese,  and 
Golden,  1988): 

•  A  constant  value  of  T;  T(t)  =  C 

•  An  arithmetic  function  of  T;  T(t)  =  T(t  -  1)  -  C 

•  A  geometric  function;  T(t)  =  a(t)T(t  -  1) 

•  An  inverse;  T(t)  =  C/(  1  +  ta) 

•  A  logarithmic  function;  T(t)  =  C /ln(l  +  t) 
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(6)  The  last  step  in  the  SA  algorithm  is  to  iterate  until  the  stopping  criteria  is  met. 
Several  classes  of  stopping  criteria  can  be  used  (Collins,  Eglese  and  Golden,  1988). 

•  In  the  simplest  criteria,  a  fixed  amount  of  CPU  time  is  allocated,  and  the  process 
stops  when  the  time  runs  out  (Brooks  and  Verdini,  1988:429). 

•  Another  approach  is  to  compare  the  value  of  the  objective  function  at  each  itera¬ 
tion  with  the  value  at  previous  iterations.  Under  this  criteria,  stop  when  the  func¬ 
tion  reaches  a  stable  value  for  a  certain  number  of  iterations  (Brooks  and  Verdini, 
1988:430). 

•  If  there  is  a  certain  target  value  of  the  function  (a  known  or  estimated  minimum), 
stop  when  the  configuration  meets  the  target  (Brooks  and  Verdini,  1988:430). 

•  When  the  algorithm  is  near  the  optimum  the  ratio  of  accepted  configurations  to 
total  configurations  will  become  very  small.  The  algorithm  can  stop  when  this  ratio 
reaches  a  predetermined  value  (Ingber,  1993b:6). 

•  If  none  of  the  other  criteria  are  met,  stop  when  the  temperature  reaches  a  value  near 
zero  (Collins,  Eglese,  and  Golden,  1988:212).  At  this  point  the  algorithm  degenerates 
to  a  random  search,  and  the  cost  of  further  annealing  should  be  compared  to  the 
benefit  that  might  be  gained. 

When  the  correct  stopping  criteria  is  met,  the  algorithm  will  have  a  solution  close  to  the 
global  optimum. 

2.4  New  Developments 

Until  about  1987,  simulated  annealing  was  considered  useful  for  finding  only  local 
optima.  However,  new  references  in  the  field  refer  to  SA  finding  global  optima  rather  than 
local  optima.  Brooks  and  Verdini  report:  “The  rapid  increase  in  inexpensive  computing 
power  has  contributed  to  an  increase  in  interest  in  solving  global  optimization  problems 
using  stochastic  methods  (Brooks  and  Verdini, 1988:427).”  Given  enough  iterations,  SA 
can  be  expected  to  find  the  global  optimum.  With  a  powerful  enough  computer,  this  may 
be  realistic  for  all  discrete  optimizations  and  for  many  continuous  functions. 
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Some  new  methods  are  being  investigated  to  help  speed  up  the  SA  process.  Gold¬ 
stein  and  Waterman  have  considered  varying  the  size  of  the  neighborhood  of  the  acceptable 
steps  by  changing  the  permutation  mechanism  (Goldstein  and  Waterman,1988:411).  Tovey 
wrote  Simulated  Simulated  Annealing  to  discuss  three  other  methods  of  speeding  the  pro¬ 
cess  (Tovey,  1988).  He  calls  them  the  Surrogate  Function,  Neighborhood  Prejudice,  and 
Target  Prejudice  swindling  ideas.  These  have  potential  for  improving  the  speed  of  SA 
by  making  each  iteration  more  efficient.  This  suggests  the  need  to  count  the  number  of 
iterations  that  SA  uses  for  each  solution.  An  old  method  for  speeding  SA  is  to  make  it 
interactive  with  a  human  operator.  This  method  is  gaining  new  attention  as  interaction 
techniques  are  improved.  With  a  human  to  intervene  when  the  process  takes  a  bad  turn, 
SA’s  efficiency  can  be  greatly  improved  (Tovey,  1988:405).  New  parallel  processing  hard¬ 
ware  will  also  make  SA  more  attractive  by  increasing  the  speed  of  processing  when  making 
many  iterations  and  when  checking  the  constraints  imposed  on  the  solution. 

Overall,  the  literature  on  Simulated  Annealing  has  touched  many  different  fields. 
The  algorithm  is  under  rapid  development  by  many  researchers.  As  yet,  the  application  of 
SA  to  structural  optimization  problems  has  not  appeared  in  the  literature.  However,  the 
foundation  of  SA  in  general  has  been  thoroughly  developed,  opening  the  door  to  research 
on  this  particular  application. 
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III.  Simulated  Annealing  and  Benchmarking 

This  chapter  outlines  the  basic  tools  used  to  evaluate  the  application  of  Simulated 
Annealing  to  structural  optimization  problems.  It  highlights  the  theoretical  development 
of  the  standard  Simulated  Annealing  algorithm  and  the  features  specific  to  Adaptive  Simu¬ 
lated  Annealing,  the  software  package  implemented  for  this  research  (Ingber,  1993b).  The 
concept  of  benchmarking  is  introduced,  and  the  specifics  of  the  benchmark  problems  are 
discussed. 

3.1  Theoretical  Development  of  the  SA  algorithm 

The  standard  SA  algorithm  uses  a  Boltzmann  distribution  to  control  the  probability 
of  accepting  a  worse  solution  at  each  iteration.  As  discussed  in  Chapter  2,  the  Boltzmann 
distribution  is  a  negative  exponential  with  parameters  to  control  the  shape  of  the  curve, 
thus  controlling  the  probability  of  accepting  a  worse  solution.  Each  time  a  worse  solution 
is  proposed,  the  value  of  the  Boltzmann  distribution  is  compared  to  the  value  of  a  random 
variable  drawn  from  a  uniform  distribution.  If  the  Boltzmann  value  is  higher  than  the 
uniform  random  variable,  the  new  solution  is  accepted,  even  though  the  cost  (weight)  is 
higher.  At  each  iteration,  there  is  some  finite  probability  of  accepting  a  worse  solution. 
However,  this  probability  approaches  zero  near  the  end  of  the  program,  as  the  temperature 
approaches  the  “freezing”  point. 

The  primary  control  parameter  in  the  Boltzmann  distribution  is  the  temperature. 
This  term  initially  referred  to  the  actual  temperature  in  a  physical  annealing  process,  and 
so  was  held  over  by  most  users  of  SA.  In  Simulated  Annealing,  “temperature”  refers  to  a 
control  parameter  for  the  negative  exponential  distribution,  even  if  it  looks  different  from 
the  original  Boltzmann  distribution.  Because  the  temperature  term  is  in  the  denominator 
of  the  negative  exponential  term,  a  high  temperature  yields  a  large  value  from  the  Boltz¬ 
mann  distribution,  and  a  high  probability  of  accepting  a  worse  solution.  This  is  the  case 
at  the  beginning  of  the  process.  As  the  temperature  is  decreased,  the  value  drawn  from 
the  distribution  decreases,  and  the  probability  of  accepting  a  worse  solution  decreases. 
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8.1.1  Global  Optimality.  It  has  recently  been  proven  that,  with  an  infinite  num¬ 
ber  of  iterations,  Adaptive  Simulated  Annealing  will  find  the  global  optimum  (Ingber, 
1993a:39).  Since  there  is  always  a  finite  probability  of  accepting  a  worse  solution  at  each 
iteration,  the  algorithm  can  always  leave  a  local  optimum.  As  the  number  of  iterations 
approaches  infinity,  Adaptive  Simulated  Annealing  must  leave  all  of  the  local  optima  and 
find  the  global  optimum.  At  each  iteration  of  the  algorithm,  Adaptive  Simulated  Anneal¬ 
ing  saves  the  best  cost  yet ,  and  the  global  optimum  will  be  saved  even  if  the  algorithm 
leaves  this  configuration. 

3.2  The  Adaptive  Simulated  Annealing  Algorithm 

Adaptive  Simulated  Annealing  him  been  developed  and  modified  over  the  last  ten 
years  by  Dr.  Lester  Ingber  (Ingber,  1993b).  The  code  was  originally  developed  and  made 
available  in  1987  as  Very  East  Simulated  Reannealing,  and  is  under  continuing  development. 

3.2.1  Temperatures.  In  Adaptive  Simulated  Annealing,  a  temperature  term  is  used 
to  control  the  step  size  from  one  solution  to  the  next  proposed  solution  as  well  as  to  control 
the  probability  of  accepting  a  new  “worse”  solution.  The  temperature  which  controls  the 
acceptance  probability  is  called  the  cost  temperature  and  the  control  for  the  step  size  is 
the  parameter  temperature  (Figure  3.1).  If  a  feasible  solution  is  available,  a  new  proposed 
solution  is  generated  from  it.  The  new  proposed  solution  is  projected  uniformly  along  each 
variable  (dimension)  within  the  upper  and  lower  bounds  defined  for  that  variable.  When 
the  parameter  temperature  is  very  high,  there  is  a  high  probability  of  choosing  a  value  far 
from  the  current  value  for  each  variable.  At  this  high  temperature  almost  any  value  within 
the  bounds  defined  for  the  variable  is  likely  to  be  chosen  for  the  new  proposed  solution. 
When  the  parameter  temperature  is  reduced,  there  is  a  lower  probability  of  choosing  a 
value  far  from  the  starting  value  for  each  variable.  This  allows  the  algorithm  to  survey  the 
entire  solution  space,  then  close  in  on  the  optimum.  If  there  is  no  initial  feasible  solution, 
the  parameter  temperature  remains  high  and  proposed  solutions  are  created  by  randomly 
choosing  variable  values  within  the  upper  and  lower  bounds  defined  for  each  variable,  until 
a  feasible  solution  is  found. 
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Figure  3. 1  Parameter  Temperature  Compared  to 
Uniform  Distribution 
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3.2.2  Fundamental  Distributions  and  Equations  (Ingber,  1993b:5).  There  are  five 
fundamental  equation*  which  control  the  function  of  Adaptive  Simulated  Annealing. 

•  The  Parameter  Generating  PDF  generates  new  variable  values: 

p(k  +  l)  =  p(k)  +  y(B  -  A) 

where  p(k)  and  p(k  + 1)  are  the  current  parameter  value  and  the  next  for  the  variable 
representing  one  dimension.  The  y  parameter  is  a  uniform  [—1, 1]  random  variable. 
The  B  and  A  terms  represent  the  upper  and  lower  bounds  defined  for  the  variable. 

•  The  probability  of  using  this  newly  generated  parameter  value  in  the  new  proposed 
solution  is  controlled  by  the  parameter  temperature  function: 

where  Tp(kp)  is  the  parameter  temperature  at  iteration  kp  defined  in  the  algorithm 
according  to  the  annealing  schedule  created  by  the  Annealing  Temperature  Schedule. 
This  is  the  behavior  described  previously:  a  high  parameter  temperature  gives  a  high 
probability  of  making  a  large  step,  and  a  low  temperature  gives  a  low  probability  of 
making  a  large  step. 

•  The  Parameter  Annealing  Temperature  Schedule  controlling  the  parameter  temper¬ 
atures  is  given  by: 


Tp(kp)  =  Tp(0)exp(-Wk'p/D) 

where  Tp(kp)  and  Tp(0)  are  the  current  temperature  and  the  initial  temperature, 
respectively,  W  is  the  current  weight,  kp  counts  the  number  of  iterations  completed 
in  selecting  values  for  this  parameter,  and  D  is  the  number  of  dimensions.  Note  that 
as  the  weight,  W,  is  reduced,  the  temperature  tends  to  rise.  However,  the  number  of 
iterations  increases  steadily,  and  reduces  the  temperature.  It  is  this  balance  between 
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the  weight  and  the  number  of  iterations  that  drives  the  annealing  schedule  for  the 
temperatures  of  the  parameters. 

•  The  cost  temperature  (Acceptance  PDF)  controls  the  probability  of  accepting  worse 
solutions: 


F  =  exp  ^ 


Te(ke) 


where  W(ke)  and  W(ke  - 1)  are  the  weights  (or  costs)  of  the  structure  at  the  current 
and  previous  solutions,  and  Tc(ke)  is  the  assigned  cost  temperature  according  to  the 
Annealing  Temperature  Schedule.  This  value  is  compared  to  a  uniform  [0,1]  random 
variable  U  (Figure  3.1).  If  F  >  U,  the  new  solution  is  accepted;  if  F  <  U,  another 
solution  is  tried. 


•  The  cost  temperature  is  reduced  according  to  the  Coat  Annealing  Temperature  Sched¬ 
ule: 


Tc{ke)  =  Te(0)exp(-WJbe1/x>) 

This  cost  temperature  schedule  is  similar  to  the  parameter  temperature  schedule 
except  that  kc  counts  the  number  of  iterations  tried  for  the  cost  function. 

3.2.3  Initial  Conditions  and  Stopping  Criteria  are  required  for  the  standard  SA 
algorithm  as  well  as  for  Adaptive  Simulated  Annealing.  With  the  exception  of  the  rean¬ 
nealing  parameters  and  the  specific  names  of  the  other  parameters,  the  terms  used  here 
can  be  applied  to  the  standard  SA  algorithm.  The  initial  conditions  of  the  optimization 
determine  the  initial  feasible  solution,  initial  temperatures,  and  user  selectable  features. 
Some  of  these  user-controllable  features  Eire: 

•  Initial  Coat  Temp  can  be  user  defined  to  adjust  the  initial  rate  of  Euxeptance. 

•  Include  Integer  Parameters  ceui  be  set  to  make  Adaptive  Simulated  Annesiling  find 
integer  solutions  only  (Integer  Programming). 
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•  User  Initial  Parameter*  can  be  set  to  give  Adaptive  Simulated  Annealing  a  user 
defined  initial  feasible  solution. 

•  User  Initial  Parameter*  Temp*  can  be  set  to  a4just  bow  fast  Adaptive  Simulated 
Annealing  initially  surveys  the  solution  space. 

The  stopping  criteria  define  when  Adaptive  Simulated  Annealing  stops  making  itera¬ 
tions,  and  considers  reannealing,  or  (for  SA  in  general)  stops  annealing  at  the  final  solution. 
The  process  stops  when  any  one  of  the  selected  stopping  criteria  is  met,  so  the  stopping 
criteria  plays  an  important  role  in  determining  the  precision  of  the  solution.  Again,  these 
criteria  apply  to  generic  SA  as  well  as  to  Adaptive  Simulated  Annealing.  Some  of  these 
tolerances  are: 

•  Limit  Acceptance*  defines  the  maximum  number  of  feasible  solutions  Adaptive  Sim¬ 
ulated  Annealing  accepts  before  stopping. 

•  Limit  Invalid  Generated  State*  defines  the  maximum  number  of  infeasible  solutions 
Adaptive  Simulated  Annealing  generates  before  stopping. 

•  Accepted  to  Generated  Ratio  defines  the  smallest  allowable  ratio  of  accepted  to  gen¬ 
erated  solutions.  When  the  algorithm  is  close  to  the  minimum,  the  cost  temperature 
may  be  low,  so  few  new  solutions  will  be  accepted  and  this  ratio  approaches  zero. 

•  Cost  Precision  defines  the  smallest  difference  between  cost  (weight)  values  of  the 
objective  function  considered  to  be  significant.  This  influences  the  use  of  Maximum 
Cost  Repeat,  which  stops  the  iteration  process  when  the  cost  (weight)  is  repeated  a 
defined  number  of  times. 

•  Parameter  Temp  Test  sets  a  flag  when  the  parameter  temperature  is  reduced  to  a 
defined  value.  When  the  parameter  temp  is  near  zero,  only  very  small  steps  are  likely 
to  be  made  from  one  feasible  solution  to  the  next,  and  it  is  relatively  expensive  to 
continue  searching  compared  to  the  potential  benefit. 

•  Cost  Temp  Test  sets  a  flag  when  the  cost  temperature  is  reduced  to  a  defined  value. 
When  the  cost  temperature  is  very  low,  there  is  a  very  low  probability  of  accepting 
a  new  higher  cost,  indicating  that  the  search  is  near  the  optimum.  At  this  point  the 
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algorithm  is  an  ordinary  random  search,  accepting  only  improved  solutions  at  each 
iteration. 

3.3  Features  Specific  to  Adaptive  Simulated  Annealing 

This  code  is  available  free  from  Dr.  Ingber.  It  is  made  to  be  highly  portable  for 
platforms  ranging  from  microcomputers  to  supercomputers.  It  is  written  in  the  “C”  pro¬ 
gramming  language,  which  is  modern  and  flexible,  and  the  code  is  setup  for  ANSI  C  or  for 
previous  versions.  Dr.  Ingber  himself  is  available  for  consultation  by  electronic  mail.  In 
fact,  he  provides  feedback  to  users  and  updates  to  the  code  via  a  mailing  list  for  anyone 
interested  in  the  code.  This  communication  among  users  creates  the  interaction  among 
users  which  is  necessary  for  research  progress. 

An  important  underlying  reason  for  using  the  Adaptive  Simulated  Annealing  code 
for  this  investigation  is  its  many  user-controllable  options.  These  options  make  the  code 
flexible  and  allow  the  user  to  target  the  specific  features  of  SA  which  are  needed  for  a  specific 
task.  Adaptive  Simulated  Annealing  implements  the  basic  SA  algorithm,  and  makes  it  very 
user  friendly.  Default  values  for  each  of  the  options  are  built  into  the  Adaptive  Simulated 
Annealing  algorithm.  Some  of  these  options  that  are  specific  to  the  Adaptive  Simulated 
Annealing  algorithm  are: 

•  Reannealing.  In  the  reannealing  process,  when  the  initial  stopping  criteria  is  met 
the  parameter  temperatures  are  rescaled  and  the  annealing  is  restarted.  This  allows 
greater  precision  in  the  solution  by  minimizing  round-off  error.  Reannealing  is  an 
optional  process,  selectable  by  the  user,  along  with  the  number  of  restarts  to  be 
made. 

•  Self  Optimizing.  In  case  the  initial  conditions  are  difficult  to  define,  the  Adaptive 
Simulated  Annealing  algorithm  will  anneal  the  annealing  process.  This  process  op¬ 
timizes  the  initial  conditions  for  a  subset  of  the  solution  space,  then  provides  these 
initial  conditions  for  the  full  solution.  This  process  is  CPU-intensive,  but  it  gives  the 
program  a  starting  point  in  case  the  defaults  don’t  work  and  the  user  has  no  other 
method  of  identifying  initial  conditions. 
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•  Curvature  Zero  tells  Adaptive  Simulated  Annealing  not  to  calculate  the  slope  of  the 
solution  space  at  the  optimal  point.  This  calculation  is  used  when  rescaling  the 
parameters  based  on  curvature,  prior  to  reannealing. 

•  Quench  Parameters  allows  the  annealing  process  to  proceed  to  a  defined  point,  then 
the  parameter  temperature  is  reduced  to  a  value  near  sero.  This  effectively  stops  the 
annealing  process  at  that  point,  and  the  search  degenerates  to  an  ordinary  random 
search.  This  option  allows  for  a  quick  solution  in  the  case  of  many  dimensions  or 
a  complex  system  of  equations  to  evaluate.  However,  the  solution  found  is  very 
approximate  and  the  theoretical  guarantee  of  global  optimality  is  lost. 

•  Adaptive  Simulated  Annealing  has  an  option  to  keep  track  of  CPU-time  used  in 
finding  a  solution.  This  makes  it  easy  to  compare  the  performance  of  the  algorithm 
with  standard  benchmark  problems  on  a  standard  computer  platform. 

•  The  input/output  functions  are  very  flexible.  This  feature  is  especially  user  friendly. 
The  user  can  easily  define  the  input  and  output  options,  as  well  as  the  name  of  the 
output  file  and  the  media  where  it’s  written. 

•  To  make  the  code  applicable  to  many  computer  platforms,  the  machine  precision, 
and  overload  values  are  user  selectable. 

3-4  Benchmarking  in  Structural  Optimization 

Structural  optimization  is  carried  out  using  various  optimization  packages.  Typically, 
to  compare  the  performance  of  one  optimizer  against  others,  standardized  “benchmark” 
problems  are  run  with  each  optimizer  under  conditions  as  similar  as  possible.  The  bench¬ 
mark  problems  should  give  a  representative  sample  of  the  types  of  problems  that  the 
optimizers  can  be  expected  to  solve,  as  well  as  a  common  ground  for  comparison  among 
the  optimizers. 

The  relative  quality  of  the  solution  found,  the  number  of  iterations  and  the  time 
required  to  And  the  solution  can  be  compared  among  the  optimizers.  The  relative  quality 
of  the  solution  is  the  easiest  of  these  to  compare;  normally  the  lowest  value  that  meets  the 
constraints  is  the  best  solution.  Other  criteria  are  harder  to  compare  among  optimizers. 
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The  number  of  iterations  required  depends  on  the  design  of  the  algorithm,  and  may  depend 
on  the  definition  of  an  “iteration”  for  a  certain  algorithm..  The  time  required  for  a  certain 
optimiser  to  find  the  solution  varies  depending  on  the  type  of  problem,  the  starting  point, 
the  computer  architecture,  and  the  precision  required. 

Many  structural  optimization  problems  can  be  formulated  as  standard  linear  or  non¬ 
linear  programs,  with  the  objective  function  and  constraints  explicitly  defined  at  the  start 
of  the  program  and  evaluated  at  each  iteration.  However,  because  of  the  complexity  of 
evaluating  highly  non-linear  functions  and  their  derivatives,  even  a  supercomputer  may 
be  overwhelmed  by  problems  with  many  variables.  To  resolve  this  shortcoming,  large 
structural  optimization  problems  are  usually  solved  with  some  type  of  active-constraint 
strategy.  In  this  formulation,  the  constraints  are  not  explicitly  defined  at  the  beginning  of 
the  non-linear  program.  Rather,  the  active  constraints  are  redefined  at  each  iteration  and 
only  these  constraints  are  evaluated.  This  process  resolves  some  of  the  size  and  complexity 
difficulties  in  large  problems,  but  requires  the  extra  step  of  redefining  the  active  constraints 
at  each  iteration. 

The  active-constraint  formulation  does  not  lend  itself  to  SA,  which  evaluates  all  of 
the  constraints  at  each  iteration.  For  SA,  this  saves  the  effort  of  frequently  redefining  the 
constraints,  but  requires  working  with  a  larger  non-linear  program.  However,  since  SA 
does  not  have  to  calculate  the  derivatives  of  the  objective  function  and  constraints  at  each 
iteration,  a  larger  problem  may  be  easier  to  evaluate  and  may  not  overtax  the  computer’s 
capacity. 

3-4- 1  Benchmarking  with  SA.  To  evaluate  the  performance  of  SA  in  structural  op¬ 
timization,  eighteen  explicitly  defined  benchmark  structural  optimization  problems  were 
solved.  These  eighteen  problems,  along  with  the  solutions  found  by  four  other  optimizers, 
were  provided  by  the  Flight  Dynamics  Directorate  at  Wright  Laboratories.  These  prob¬ 
lems  represent  “real”  structural  optimization  problems.  They  are  formulated  as  linear  or 
non-linear  programs,  and  range  in  number  of  variables  from  two  to  eight,  in  number  of 
constraints  from  one  to  twenty-five,  and  in  complexity  from  linear  to  highly  non-linear 


3-9 


(Venkayya,  Tischler,  and  Pitrof,  1992).  None  of  the  eighteen  structural  optimisation  prob¬ 
lems  included  more  than  eight  variables. 

To  test  simulated  annealing  on  problems  of  higher  dimensionality,  two  non-linear 
programs  were  chosen  from  another  set  of  benchmark  problems  (Floudas  and  Pardalos, 
1990).  These  are  not  "real”  structural  optimisation  problems,  but  they  are  formulated 
in  a  manner  similar  to  the  structural  optimisation  problems.  They  have  thirteen  and 
twenty  variables,  respectively.  Using  these  problems  allowed  a  more  complete  test  of  the 
capacity  of  the  Adaptive  Simulated  Annealing  algorithm  in  solving  problems  with  higher 
dimensionality. 

3-4-2  Problem  Formulation.  Each  problem  is  expressed  in  the  following  form: 

Min 

F(*) 

Subject  to 

h(x)  =  0 

p(*)<0 

where  F(x)  is  a  real-valued  continuous  function,  h(x)  represents  the  set  of  equality  con¬ 
straints  and  g(x)  represents  the  set  of  inequality  constraints.  All  decision  variable  values 
must  be  non-negative,  since  the  variables  in  this  set  represent  the  physical  dimensions  of 
structures,  and  negative  values  would  normally  be  meaningless. 


3. 4-2.1  Constraints.  Except  for  upper  and  lower  bounds,  no  method  for  eval¬ 
uating  constraints  is  explicitly  built  into  the  Adaptive  Simulated  Annealing  algorithm. 
The  set  of  bounds  defines  the  neighborhood  that  the  algorithm  initially  searches.  If  there 
are  no  other  constraints,  this  represents  the  feasible  region.  However,  structural  optimiza¬ 
tion  problems  are  usually  constrained  beyond  any  upper  or  lower  bounds  on  the  individual 
variables.  In  aircraft  structural  optimization,  constraints  must  be  met  for  flutter,  displace¬ 
ment,  total  weight,  etc.,  and  the  constraints  may  make  the  actual  feasible  region  much 
smaller  than  the  neighborhood  set  by  the  bounds  on  the  variables. 


3-10 


To  ensure  that  the  constraints  were  all  met  prior  to  evaluating  the  objective  function, 
each  constraint  was  checked  for  feasibility.  If  all  of  the  constraints  were  met,  the  objective 
function  was  evaluated,  and  this  weight  was  returned  to  the  optimizer.  If  any  constraint 
was  not  met,  a  flag  was  set  and  no  value  was  returned  to  the  optimizer,  saving  the  time 
which  would  have  been  required  for  evaluating  the  objective  function  for  an  infeasible 
solution. 

Inequality  Constraints.  By  far,  most  of  the  constraints  in  structural  optimization 
problems  are  inequalities.  This  is  because,  in  most  structural  optimization,  a  given  perfor¬ 
mance  level  or  physical  characteristic  must  be  met  or  exceeded  in  finding  the  best  structure. 
In  the  formulation  for  optimizing  these  benchmark  problems,  all  inequalities,  g{x),  are  ex¬ 
pressed  as  <  constraints.  This  includes  the  cases  where  the  original  formulation  included 
a  function  which  was  bounded  above  and  below.  In  this  case  the  bounds  were  rewritten 
as  two  separate  inequality  constraints.  This  constraint  structure  is  simple.  A  formulation 
with  fewer  constraints  might  be  possible  at  the  expense  of  making  each  constraint  more 
complex. 

Equality  Constrains.  There  is  only  one  equality  constraint  in  the  entire  set  of  bench¬ 
mark  problems.  However,  since  equality  constraints  are  possible  in  structural  optimization 
problems,  consideration  was  given  to  satisfying  them.  One  way  of  satisfying  these  equality 
constraints  is  to  use  Lagrange  multipliers  and  build  the  equality  constraints  and  the  origi¬ 
nal  objective  function  into  an  augmented  Lagrangian  objective  function.  This  method  was 
not  used  because  it  increases  the  dimensionality  of  the  non-linear  program  by  introducing 
more  variables  (the  Lagrange  multipliers).  Instead  the  equality  constraint  was  used  to 
redefine  the  value  of  one  variable  in  terms  of  the  others  by  direct  elimination  of  one  vari¬ 
able.  This  redefined  term  was  then  substituted  back  into  the  problem  and  the  optimization 
was  conducted  without  equality  constraints.  This  process  makes  the  inequality  constraints 
more  complex,  but  it  reduces  the  dimensionality  of  the  problem  and  the  total  number  of 
constraints. 


3. 4-2.2  Objective  Function.  If  the  constraints  are  all  met,  the  objective  func¬ 
tion  is  evaluated  to  find  the  toted  weight  of  the  structure  with  the  new  values  of  the 
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variable*.  This  value  is  returned  to  the  optimixer,  and  is  compared  to  the  previous  value  of 
the  objective  function.  If  this  new  value  is  better  than  the  previous  value,  the  new  solution 
is  kept  as  the  current  solution.  If  it  is  not  better  than  the  previous,  it  may  still  be  kept  as 
the  current  solution  with  a  probability  depending  on  the  current  temperature. 

3. 4-2. 3  Initial  Feasible  Solution.  The  algorithm  accepts  an  initial  feasible  so¬ 
lution,  if  one  is  available.  Since  all  of  these  problems  have  been  solved  by  other  optimizers, 
a  very  good  initial  feasible  solution  was  available.  As  part  of  the  evaluation,  this  solution 
was  provided  to  the  Adaptive  Simulated  Annealing  algorithm  in  some  runs.  Additionally, 
in  some  cases,  the  known  optimum  was  used  to  narrow  the  bounds  of  the  neighborhood 
around  each  variable.  These  “unfair”  variations  in  the  initial  conditions  were  used  in  cases 
where  the  Adaptive  Simulated  Annealing  algorithm  could  not  find  a  solution,  and  were 
considered  in  the  analysis  of  the  results. 

3-4-3  Benchmarking  with  Other  Optimizers.  The  other  standard  optimizers  used 
on  the  benchmark  problems  represent  basic  techniques  currently  in  use  for  structural  opti¬ 
mization.  FUNOPT  uses  a  Generalized  Compound  Scaling  scheme,  ADS  uses  a  Modified 
Feasible  Directions  approach,  NEWSUMT  implements  a  Sequential  Unconstrained  Min¬ 
imization  with  Penalty  Function,  and  NLPQL  implements  a  Sequential  Quadratic  Pro¬ 
gramming  scheme.  All  of  the  benchmark  structural  optimization  problems  were  optimized 
by  ADS,  and  NLPQL.  Seventeen  of  them  were  optimized  by  FUNOPT,  and  only  the  first 
six  were  optimized  by  NEWSUMT  (Venkayya,  Tischler,  and  Pitrof,  1992:2).  Solutions  to 
the  two  additional  non-linear  programs  were  provided  by  Floudas  and  Pardalos  (Floudas 
and  Pardalos,  1990:  9-15). 

Non-linear  programs  frequently  have  multiple  local  optima,  and  the  solutions  found 
to  the  benchmark  problems  by  the  various  optimizers  illustrate  this  point.  Each  non-linear 
program  poses  a  unique  problem  for  each  optimizer,  depending  on  problem  structure, 
methodology,  implementation,  initial  conditions,  and  other  factors. 

3-4-4  Measure  of  Complexity.  The  number  of  local  minima,  as  well  as  the  complex¬ 
ity  of  evaluating  the  objective  function  and  constraints  depend  on  the  level  of  non-linearity 
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of  these  functions  and  the  number  of  variables.  A  linear  program  has  a  linear  objective 
function  and  constraints,  and  is  one  of  the  simplest  to  evaluate.  A  function  with  a  non¬ 
linear  objective  function  and  constraints  is  much  more  difficult  to  evaluate,  and  may  have 
many  local  optima.  It  became  apparent  during  the  course  of  this  investigation  that,  along 
with  the  number  of  variables,  the  complexity  of  the  constraints  is  an  important  factor  in 
the  success  or  failure  of  the  simulated  annealing  algorithm  in  finding  the  global  optimum. 
These  factors  determine  whether  or  not  an  optimum  is  found,  the  time  required  to  find  an 
optimum,  and  the  quality  of  the  solution  found. 

The  algorithm  initially  searches  the  entire  neighborhood  defined  by  the  bounds  on  the 
variables.  If  there  are  many  constraints,  or  they  are  complex,  the  actual  feasible  region  may 
be  much  smaller  than  this  neighborhood.  In  one  case,  the  feasible  region  was  estimated  to 
be  smaller  than  one  millionth  of  the  neighborhood.  To  illustrate  how  this  affects  the  search, 
consider  a  two-dimensional  neighborhood  the  size  of  this  standard  (8.5  x  11  inch)  sheet 
of  paper.  A  feasible  region  one  millionth  the  size  of  this  two  dimensional  neighborhood 
would  be  approximately  ^  of  the  size  of  this  letter  “0”,  even  smaller  than  a  period  (“.”) 
on  this  page.  In  this  case,  the  Adaptive  Simulated  Annealing  algorithm  starts  a  random 
search  of  the  entire  neighborhood  (8.5  x  11  inches),  and  has  a  very  small  probability  of 
finding  the  feasible  region. 

It  seemed  possible  that  some  measure  of  complexity  could  be  used  to  predict  the 
effects  that  the  constraints  and  the  number  of  variables  would  have  on  an  optimization 
by  the  Simulated  Annealing  algorithm.  After  a  review  of  the  literature  in  the  field,  and 
consultation  with  several  mathematicians,  it  was  determined  that  no  such  measure  exists. 
An  index  representing  a  Measure  of  Complexity  (MOC)  was  defined  to  help  predict  these 
effects.  The  objective  function  and  the  entire  set  of  constraints  for  a  given  problem  are 
evaluated  and  assigned  a  MOC  value  based  on  the  non-linearity  of  the  objective  function 
and  constraints,  the  number  of  variables,  and  the  number  of  constraints.  Based  on  the 
MOC  value,  a  user  may  be  able  to  make  predictions  about  the  performance  of  the  algorithm 
on  a  certain  problem.  The  MOC  index  was  not  designed  to  predict  the  performance  of 
other  optimizers.  However,  the  same  criteria  used  here  would  be  appropriate  to  build 
indexes  for  other  optimizers,  or  the  MOC  may  apply  as  presented. 
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Measure  of  Complexity  (HOC)  Calculation.  Sum  the  paint  value*  assigned  to  the 
objective  function  and  constraints,  according  to  the  following  criteria  : 

1  point  for  each  term  with  a  linear  exponent  or  negative  exponent 

2  points  for  each  term  with  an  integer  non-linear  exponent  or  integer  crossproduct 

3  points  for  each  term  with  a  non-integer  exponent 

2  points  for  each  constraint 

3  points  for  each  variable 

If  a  term  meets  the  criteria  for  more  than  one  point  value,  assign  the  highest  appropriate 
point  value  for  the  term. 

Example: 

Min 

/(*)  =  3*o*l*2  “  +  2*2 

Subject  to  : 

gl  =  z\  -  1 

gi  =  *0*2  +  *r10 


MQC  count 


f(x): 


variables : 

g1: 

g2: 

constraints : 


3  points  for  non- integer  exponent 

1  point  for  integer  exponent 
9  points  for  three  variables 

2  points  for  non-linear  exponent 
2  points  for  integer  crossproduct 
1  point  for  negative  exponent 

4  points  for  two  constraints 


Sum  HOC  22 
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Before  each  problem  was  optimised  with  the  Adaptive  Simulated  Annealing  algo¬ 
rithm,  information  was  gathered  on  the  number  of  variables,  number  and  type  of  con¬ 
straints,  the  Measure  of  Complexity,  and  variations  in  the  initial  conditions  given  to  the 
algorithm.  After  optimising,  the  best  solution  found,  the  number  of  solutions  generated, 
and  the  amount  of  time  required  to  find  the  solutions  were  noted.  Chapter  Four  shows 
how  this  information  was  used  to  analyze  the  performance  of  the  algorithm,  and  to  make 
comparisons  with  the  other  optimizers. 
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IV.  Results  and  Analysis 


This  chapter  presents  the  results  of  optimising  each  of  the  benchmark  problems  using 
the  Adaptive  Simulated  Annealing  algorithm.  The  analysis  centers  on  three  main  results. 
The  first  concerns  the  effects  of  variations  of  the  initial  conditions  and  stopping  criteria. 
Next,  the  quality  of  solutions  found  by  the  Adaptive  Simulated  Annealing  algorithm  is 
compared  to  the  quality  of  solutions  found  by  the  other  optimizers.  And  finally,  the  effects 
of  high  dimensionality  and  high  non-linearity  of  the  objective  function  and  constraints  are 
related  to  the  success  of  the  optimization. 

4.1  Variations  in  Initial  Conditions /Stopping  Criteria 

The  initial  conditions  and  stopping  criteria  given  to  an  optimizer  can  have  a  great 
impact  on  the  success  of  the  optimization.  These  parameters  may  determine  whether  or 
not  the  algorithm  finds  a  solution,  the  quality  of  the  solution  found,  and  the  time  required 
to  find  a  solution.  By  trial  and  error,  it  was  determined  that  the  initial  conditions /stopping 
criteria  that  seem  to  make  the  most  significant  difference  for  SA  in  structural  optimization 
are:  Limit  Acceptances,  Limit  Invalid  Generated  States,  Accepted  to  Generated  Ratio, 
Cost  Precision,  Maximum  Cost  Repeats,  Number  of  Cost  Samples,  User  Initial  Parameters 
(true/false),  Activate  Reanneal  (true/false),  Upper/Lower  Bounds,  and  Random  Number 
Generator  Seed.  Benchmark  Problem  One  was  used  to  evaluate  the  effects  of  variations  in 
these  initial  conditions/stopping  criteria  on  the  success  of  the  algorithm  (Table  4.1). 

To  identify  the  effects  of  varying  these  ten  parameters,  Problem  One  was  initially 
optimized  using  a  set  of  “Standard  Conditions”  (page  C.l).  Each  condition  that  was 
identified  as  having  a  potentially  significant  effect  on  the  optimization  was  isolated  and 
modified,  then  the  optimization  was  re-accomplished  for  each  change.  Analysis  of  the  effect 
of  each  variation  on  optimizing  this  problem  was  generally  useful  for  predicting  the  effects 
of  variations  in  other  problems.  No  effort  was  made  to  evaluate  interaction  effects  among 
these  variations  in  the  initial  conditions/stopping  criteria,  because  the  results  would  be  so 
specific  to  each  individual  problem. 
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Table  4.1  Effect  of  Variations  in  Initial  Condition*  and  Stopping  Crit  ria 


Modified 

Parameter 

Standard 

Value 

Modified 

Value 

Solutions 

Generated 

Solution 

Time 

Standard 

Condition 


NoModif  33453  Om  21.53s 


Limit 

Acceptances 

1000 

10000 

769257 

8m  21.53s 

1000 

10000 

33453 

Om  21.488 

Acc/Gen 

Ratio 

10“4 

10“8 

33453 

0m  21.47s 

Cost 

Precision 

10“8 

io-4 

33453 

0m  21.33s 

Max  Cost 
Repeats 

2 

5 

33453 

0m  22.31s 

No.  Cost 
Samples 

2 

5 

3155 

0m  01.99s 

User  Init 
Parameters 

Yes 

No 

29756 

0m  20.09s 

Activate 

Reanneal 

No 

Yes 

14912 

0m  09.14s 

Bound 

Change 

0  to  10 

0  to  20 

57787 

0m  38.4s 

Bound 

Change 

hh 

0  to  100 

0 

No  Feasible 
Solution 

Random  No. 
Seed 

696969 

697969 

80091 

0m  54.51s 

Random  No. 
Seed 

696969 

696971 

3735 

0m  02.55s 

-2 


Benchmark  Problem  One  was  chosen  to  evaluate  the  effects  of  these  variations  be¬ 
cause  of  its  simplicity.  It  has  only  two  linear  constraints,  one  non-linear  constraint,  and  two 
variables  in  the  objective  function  (MOC  value  of  22).  The  Adaptive  Simulated  Annealing 
algorithm  was  able  to  find  the  same  optimal  solution  under  all  but  one  of  the  variations, 
eliminating  variability  in  the  quality  of  the  solution.  This  made  the  time  required  to  solve 
the  problem  the  primary  basis  for  comparison  of  the  variations.  Generally,  the  time  re¬ 
quired  is  proportional  to  the  number  of  solutions  generated.  As  shown  in  Table  4.1,  the 
effect  of  each  variation  can  be  seen  in  the  results  of  these  tests: 

•  Limit  Acceptances  limits  the  total  number  of  feasible  solutions  accepted  by  the  op¬ 
timizer  (page  C.2).  The  effect  of  a  change  in  Limit  Acceptances  is  significant.  By 
increasing  the  number  of  acceptances  by  a  factor  of  10,  the  number  of  solutions 
generated  increased  by  a  factor  of  25,  and  the  time  required  to  find  the  solution 
also  increased  by  a  factor  of  25.  Analysis  of  intermediate  steps  in  the  optimization 
showed  that  the  actual  number  of  solutions  generated  and  the  time  required  to  find 
the  optimal  values  of  the  decision  variables  were  similar  to  those  required  under  the 
standard  conditions.  However,  the  algorithm  continued  to  “spin  its  wheels”  for  the 
additional  allowed  number  of  solutions.  To  avoid  this  waste,  the  user  can  allow  a 
relatively  small  number  of  acceptances  initially,  then  increase  the  number  allowed  in 
subsequent  optimizations  if  an  improved  solution  is  desired. 

•  Limit  Invalid  Generated  States  limits  the  number  of  infeasible  solutions  the  optimizer 
may  generate  (page  C.3).  For  this  problem,  changing  this  parameter  did  not  influ¬ 
ence  the  optimization  significantly.  This  parameter  could  be  significant  in  highly 
constrained  problems,  where  many  infeasible  solutions  will  be  generated  at  the  be¬ 
ginning  of  the  optimization.  In  that  case,  allowing  more  infeasible  solutions  could  be 
the  key  to  the  optimizer  finding  a  feasible  solution.  This  was  the  case  with  Bench¬ 
mark  Problem  Six  (pages  C.18  and  C.19).  The  algorithm  could  not  find  a  solution 
under  the  standard  conditions,  but  when  the  stopping  criteria  allowed  more  infeasible 
solutions,  the  algorithm  found  a  good  solution. 
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•  Accepted  to  Generated  Ratio  defines  the  smallest  ratio  of  accepted  solutions  to  total 
solutions  allowed  (page  C.4).  Variation  of  this  parameter  did  not  significantly  influ¬ 
ence  the  optimization  of  Problem  One.  For  problems  with  little  curvature  near  the 
optimum,  there  would  be  relatively  few  acceptances  compared  to  generated  solutions, 
and  this  parameter  could  have  a  significant  effect. 

•  Coat  Precision  defines  the  smallest  difference  considered  significant  between  cost 
(weight)  values  when  counting  cost  repeats  of  the  objective  function  for  Maximum 
Coat  Repeats  (page  C.5).  For  instance,  a  cost  of  3.01  may  be  considered  the  same 
as  3.00  if  Coat  Precision  is  set  to  a  value  greater  than  10~3.  In  Problem  One,  a 
change  in  cost  precision  did  not  make  a  significant  difference  in  the  optimization. 
This  parameter  could  be  significant  when  very  fine  precision  is  required  in  finding 
the  optimum,  and  generally  this  parameter  can  be  set  for  the  precision  needed  in  the 
solution. 

•  Maximum  Coat  Repeats  stops  the  optimization  when  the  cost  value  of  the  objective 
function  is  repeated  a  given  total  number  of  times  (page  C.6).  The  change  in  this 
value  was  not  significant  in  this  problem.  In  other  problems,  extra  cost  repeats 
caused  the  algorithm  to  “spin  its  wheels”  similar  to  the  effect  of  extra  acceptances. 
This  value  can  be  set  at  a  relatively  low  value,  and  increased  if  necessary  for  a  better 
solution. 

•  Number  of  Cost  Samples  tells  the  algorithm  how  many  samples  to  use  when  initially 
evaluating  the  “surface”  of  the  cost  function  (page  C.7).  The  more  samples  the 
algorithm  uses,  the  better  the  initial  survey  of  the  cost  function.  In  Problem  One,  an 
increase  by  a  factor  of  2.5  in  the  Number  of  Cost  Samples  decreased  the  time  required 
to  find  the  solution  by  a  factor  of  more  than  ten.  This  is  a  significant  improvement. 

•  User  Initial  Parameters  allows  the  user  to  give  the  algorithm  an  initial  feasible  so¬ 
lution  from  which  to  begin  the  search  (page  C.8).  If  an  initial  feasible  solution  is 
provided,  the  algorithm  centers  the  search  on  this  value  and  searches  in  each  direc¬ 
tion  from  this  point.  If  no  initial  feasible  solution  is  provided,  the  algorithm  searches 
the  neighborhood  defined  by  the  upper  and  lower  bounds  until  a  feasible  solution 
is  found.  In  this  problem,  the  algorithm  required  about  10  percent  fewer  generated 
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solutions  when  it  found  its  own  initial  feasible  solution,  and  the  difference  in  time 
was  proportionally  smaller.  Intuitively,  the  algorithm  should  find  the  optimum  faster 
with  a  good  initial  feasible  solution.  However,  because  of  the  random  nature  of  the 
algorithm’s  search,  this  is  not  always  the  case.  In  runs  where  an  infeasible  solution 
was  given  as  the  starting  point,  the  algorithm  generally  could  not  find  the  feasi¬ 
ble  region.  For  these  reasons,  consideration  should  be  given  to  setting  User  Initial 
Parameters  to  false. 

•  Activate  Reanneal  allows  the  algorithm  to  reach  a  stopping  point,  then  re-scale  the 
parameter  temperatures  and  begin  the  annealing  again  (page  C.9).  Normally  this  i<> 
done  to  improve  the  quality  of  the  solution  by  reducing  round-off  error.  In  Problem 
One,  switching  this  option  to  true  did  not  change  the  optimal  solution  found,  but 
it  reduced  the  number  of  solutions  generated  by  a  factor  of  0.5,  and  reduced  the 
solution  time  proportionately.  This  result  opens  the  door  to  both  unproved  quality 
of  solution  and  improved  solution  times. 

•  The  Upper/Lower  Bounds  define  the  neighborhood  initially  searched  by  the  algo¬ 
rithm  (page  C.10).  In  this  case,  the  optimal  solution  was  at  (0.55,  0.10).  When 
the  lower  and  upper  bounds  were  set  to  zero  and  ten,  respectively,  the  algorithm 
found  the  optimum.  When  the  upper  bound  was  changed  to  twenty,  the  number  of 
solutions  generated  increased  by  a  factor  of  almost  two  and  the  time  required  in¬ 
creased  proportionately.  When  the  upper  bound  was  increased  to  100,  the  algorithm 
could  not  find  a  feasible  solution.  This  is  because  it  was  searching  such  a  large  space 
compared  to  the  feasible  region.  In  this  case,  the  probability  of  finding  a  feasible 
solution  via  random  search  is  very  small.  This  problem  is  significant  whenever  the 
neighborhood  defined  by  the  bounds  is  much  larger  than  the  feasible  region  defined 
by  the  constraints.  The  problem  of  a  large  neighborhood  size  compared  to  the  feasi¬ 
ble  region  became  significant  for  Benchmark  Problems  Seventeen  and  Eighteen.  This 
issue  is  discussed  in  more  detail  in  section  4.3  (Dimensionality  and  Constraints). 

•  Benchmark  Problem  Four  was  given  negative  values  as  a  variation  of  its  lower  bounds 
(pages  C.15  and  C.16).  Normally,  structural  optimization  problems  do  not  allow 
for  negative  values  of  the  decision  variables.  However,  to  allow  for  a  case  where  a 
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comparison  (i.e.  right  wing/left  wing)  could  be  expressed  as  positive/negative  values 
of  a  variable,  the  algorithm  can  find  a  solution. 

•  The  Seed  Value  for  the  random  number  generator  influences  the  Uniform  Random 
Variable  value  which  the  algorithm  compares  with  the  temperature  (page  C.10)  and 
bo,  the  number  of  acceptances.  In  this  case,  the  algorithm  found  the  solution  much 
more  quickly  with  one  of  the  alternate  seed  values  and  much  more  slowly  with  the 
other  alternate  seed  value.  In  each  case,  the  global  optimum  was  found,  but  the  time 
varied  widely.  The  effect  seems  to  be  unpredictable.  This  illustrates  that  the  seed 
value  for  the  random  number  generator  can  impact  the  success  of  the  optimization, 
and  seed  values  should  be  tested  carefully  before  use.  This  is  normally  done  by  the 
originator  of  a  random  number  generator. 

Other  variations  in  the  initial  conditions/ stopping  criteria  are  possible,  but  weren’t 
considered  significant  in  this  application.  For  instance,  the  Include  Integer  Parameters 
option  would  certainly  influence  the  optimization,  but  this  research  is  not  concerned  with 
integer  programming,  so  no  effort  was  made  to  evaluate  this  effect.  The  complete  set  of 
initial  conditions/stopping  criteria  is  listed  in  Appendix  B. 

4-2  Quality  of  Solutions  Found 

For  the  problems  that  the  Adaptive  Simulated  Annealing  algorithm  was  able  to  solve, 
the  quality  of  solution  was  excellent  compared  to  the  other  optimizers.  In  the  worst  case, 
the  Adaptive  Simulated  Annealing  algorithm’s  solution  was  two  percent  higher  than  the 
best  of  the  other  optimizers’  solutions.  But  in  all  other  cases,  the  algorithm  found  the  best 
solution  or  one  of  the  best  solutions.  Table  4.2  lists  the  solutions  found  by  the  Adaptive 
Simulated  Annealing  algorithm  and  by  the  other  four  optimizers.  The  values  given  in  Table 
4.2  for  the  Adaptive  Simulated  Annealing  solutions  are  the  best  found  among  all  the  runs 
for  each  problem.  These  solutions  were  not  generally  found  with  the  standard  conditions. 
Rather,  the  initial  conditions  and  stopping  criteria  were  modified  as  necessary  to  find  the 
best  combination  for  each  problem. 
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All  five  optimizers  found  comparable  answers  to  Problems  One  through  Six.  ASA, 
FUNOPT,  ADS,  and  NLPQL  found  comparable  answers  for  Problems  Seven  through  Six¬ 
teen,  although  ASA’s  solution  to  Problem  Twelve  is  about  two  percent  higher  than  the 
best  of  the  other  optimizers. 

ASA  found  solutions  to  the  highly  constrained  problems  (Seventeen  and  Eighteen) 
only  after  the  bounds  on  the  problem  were  reduced  to  a  very  small  part  of  the  original 
neighborhood,  and  centered  on  the  optimal  solutions  found  by  the  other  optimizers.  This 
is  discussed  further  in  Section  4.3,  but  analysis  of  the  quality  of  the  solution  must  consider 
this  fact.  Even  with  the  reduced  bounds,  the  solution  ASA  found  for  Problem  Seventeen 
has  a  fifteen  percent  higher  weight  than  the  best  solution  found  by  the  other  optimizers. 
ASA’s  solution  to  problem  eighteen  (with  the  modified  bounds)  compares  favorably  with 
the  solutions  found  by  the  other  optimizers. 

It  should  be  noted  that  some  of  the  variation  between  solutions  found  by  the  optimiz¬ 
ers  can  be  attributed  to  the  fact  that  the  solution  space,  near  the  optimum,  may  be  almost 
flat.  In  this  case,  it  is  relatively  expensive  to  continue  a  search  near  the  optimum  compared 
to  the  potential  benefit,  so  most  algorithms  stop  when  “close  enough”  to  the  optimum. 
In  this  investigation,  differences  between  solutions  found  by  the  various  optimizers  were 
considered  noteworthy  if  they  were  larger  than  one  percent. 

Alternate  Optimal  Solutions.  Benchmark  Problem  Seven  illustrates  the  property  of 
alternate  optimal  solutions,  found  by  varying  the  initial  feasible  solution  (pages  C.20  and 
C.21).  The  optimization  was  started  at  various  initial  feasible  solutions  and  in  each  case 
a  different  optimal  point  was  found.  The  objective  function  value  was  the  same  for  all  of 
these  points. 

Problems  Nineteen  and  Twenty  came  from  a  different  problem  set  than  the  first 
eighteen,  and  the  other  four  optimizers  were  not  used  to  solve  them  (Flouda:  and  Pardalos, 
1990).  ASA  found  the  global  optimum  for  Problem  Nineteen  (under  Standard  Conditions). 
It  could  not  find  any  solution  for  Problem  Twenty,  even  when  the  neighborhood  was 
reduced  to  10~ao  of  the  original  neighborhood  and  centered  on  the  solution  provided  by 
Floudas  and  Pardalos. 
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Table  4.2  Quality  of  ASA  Solutions  Compared  to  Other  Optimise™ 


Prob  ASA  FUNOPT  ADS 


NEWSUMT 


II 

5.606 

5.61 

5.61 

5.61 

5.61 

2 

1.509 

1.514 

1.504 

1.508 

1.519 

3 

18.474 

18.69 

18.46 

18.47 

18.46 

4 

1.340 

1.340 

1.340 

1.340 

1.341 

5 

1560.129 

1560.17 

1560.10 

1560.06 

1560.64 

6 

2994.31 

2997.61 

2997.17 

2994.89 

2990.73 

H 

*112500 

112500 

112500 

112500 

** 

8 

*10250 

10250 

10250 

10250 

** 

9 

0.200 

BH 

0.232 

m 

** 

10 

0.503 

BH 

0.499 

0.500 

** 

11 

-1.00 

-0.979 

-1.00 

-1.00 

** 

12 

53.419 

52.767 

52.055 

52.000 

** 

13 

-8.333 

-8.332 

-8.333 

-8.333 

** 

14 

94.164 

93.180 

93.277 

93.254 

** 

15 

3.500 

3.500 

3.500 

3.500 

** 

16 

9.037 

9.521 

9.036 

9.037 

** 

17 

*1042.77 

** 

912.26 

911.88 

** 

18 

*3.954 

3.928 

3.989 

3.951 

** 

19 

-15.0 

** 

** 

** 

** 

20 

No  Solution 

#* 

** 

** 

** 

^Modified  bounds,  **Not  solved  by  this  optimizer 
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4-3  Dimensionality  and  Constraints 

Dimensionality.  High  dimensionality  and  high  degree  of  constraint  were  both  signif¬ 
icant  factors  in  determining  the  success  of  the  Adaptive  Simulated  Annealing  algorithm  in 
solving  the  benchmark  problems.  “Prom  the  complexity  point  of  view  global  optimisation 
problems  belong  to  the  class  of  NP-hard  problems.  This  means  that  as  the  input  sise  of  the 
problem  increases  the  computational  time  required  to  solve  the  problem  is  expected  to  grow 
exponentially”  (Floudas  and  Pardalos,  1990:2).  This  is  because  the  search  must  expand 
in  a  new  dimension  representing  each  variable  added,  while  retaining  all  of  the  previous 
dimensions  in  the  search.  For  example,  in  finding  length,  area,  and  volume;  each  added 
dimension  is  multiplied  by  the  previous  dimensions.  As  the  search  proceeds  from  length, 
to  area,  to  volume;  the  number  of  dimensions  increases  from  one,  to  two,  to  three;  and  the 
“size”  increases  from  first  power  to  second  power,  to  third  power.  For  higher  dimensions 
the  “size”  increases  to  fourth  power,  and  fifth  power,  and  so  on.  Using  a  random  search, 
this  increase  in  dimensionality  eventually  overwhelms  the  capacity  of  the  algorithm. 

Non-linearity  of  Constraints.  The  non-linearity  and  number  of  constraints  in  each 
of  the  benchmark  problems  were  also  significant  factors  in  determining  the  success  of 
the  algorithm  in  solving  the  problems.  In  a  problem  with  many  or  highly  non-linear 
constraints,  the  feasible  region  may  be  a  small  put  of  the  neighborhood  defined  by  the 
upper  and  lower  bounds  on  each  variable.  In  a  highly  constrained  problem,  a  random 
search  of  the  neighborhood  is  unlikely  to  find  the  feasible  region.  To  help  identify  this 
effect,  the  problems  which  could  not  be  solved  with  the  original  bounds  were  modified. 
For  Problem  Seventeen,  the  neighborhood  had  to  be  reduced  to  approximately  10~6  of 
the  original  neighborhood  and  centered  near  the  optimum  before  the  algorithm  could  find 
a  solution.  For  Problem  Eighteen,  the  reduced  neighborhood  was  approximately  10-8  of 
the  original  neighborhood  for  the  algorithm  to  find  a  solution.  For  Problem  Twenty,  the 
neighborhood  was  reduced  to  approximately  10“ 20  of  the  original,  and  the  algorithm  still 
could  not  find  a  feasible  solution.  Note  that  the  bounds  on  these  problems  could  not 
have  been  reduced  this  way  unless  the  optimal  solutions  were  known  in  advance,  so  the 
algorithm  wasn’t  really  solving  the  problems. 
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4-3. 1  Measure  of  Complexity.  Benchmark  Problems  Seventeen  and  Eighteen  have 
high  levels  of  constraint  and  Benchmark  Problems  Nineteen  and  Twenty  have  high  dimen¬ 
sionality.  It  is  difficult  to  isolate  the  effect  of  a  high  level  of  constraint  from  the  effect  of 
high  dimensionality  in  the  results  of  this  investigation  because  these  two  effects  interact. 
In  an  attempt  to  combine  and  quantify  these  effects,  a  Measure  of  Complexity  (MOC)  was 
calculated  for  each  of  the  benchmark  problems.  This  is  a  weighted  sum  which  considers 
the  level  of  non-linearity  of  the  constraints  and  objective  function,  the  total  number  of 
constraints,  and  the  number  of  variables  in  each  problem  (Section  3.4.4).  These  factors, 
as  well  as  the  solution  time  for  each  benchmark  problem  are  listed  in  Table  4.3. 

Standard  Conditions.  To  validate  the  solution  times  reported  in  Table  4.3,  all  of  the 
problems  were  initially  optimized  under  Standard  Conditions.  Some  of  the  problems  could 
not  be  solved  under  the  Standard  Conditions,  and  these  are  highlighted  in  the  table.  For 
these  problems,  the  Standard  Conditions  were  modified  as  little  as  possible  to  allow  the 
algorithm  to  find  a  solution.  (The  Standard  Conditions  are  listed  in  Appendix  B.) 

4-3.2  Analysis  of  the  Effects.  The  results  of  optimizing  each  problem  are  presented 
in  Table  4.3.  The  Adaptive  Simulated  Annealing  algorithm  solved  problems  with  Measure 
of  Complexity  (MOC)  values  below  30  quickly  and  accurately.  All  of  the  problems  with 
Measure  of  Complexity  (MOC)  values  of  20  and  below  were  solved  in  less  than  eleven 
seconds  CPU-time,  under  the  Standard  Conditions.  All  of  the  problems  with  MOC  val¬ 
ues  of  30  or  less  were  solved  in  less  than  thirty  seconds  CPU-time,  also  under  Standard 
Conditions. 

Problems  having  MOC  values  between  55  and  106  are  in  a  transition  zone.  The 
algorithm  was  able  to  find  solutions,  but  with  some  difficulty.  Problems  Six  and  Sixteen 
have  MOC  values  of  55  and  73  respectively.  They  were  solved  in  less  than  one  minute,  but 
only  after  modifications  to  the  Standard  Conditions.  Problem  Six  required  more  Invalid 
Generated  States  and  Problem  Sixteen  required  a  modified  bound.  For  these  problems, 
knowing  the  optimal  solution  in  advance  was  not  required  to  make  the  modification  to 
the  Standard  Conditions.  For  problems  Seventeen  and  Eighteen,  with  MOC  values  of  106 
and  82  respectively,  the  bounds  had  to  be  modified  significantly  before  a  solution  could  be 
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Table  4.3  Effect  of  Dimensionality  and  Constraint!  on  Solution  Time 


Prob 

Number 

Vars 

Non-Lin 

Const 

Meas  of 
Complex 

Solution 

Time 

II 

— 

2 

, - 

! 

2 

1 

22 

- - - 

Oh  0m  38.4s 

2 

2 

0 

2 

19 

Oh  0m  1.77s 

3 

2 

0 

2 

17 

Oh  0m  1.84s 

H 

5 

0 

1 

28 

Oh  0m  22.32s 

5 

3 

0 

1 

19 

Oh  0m  3.52s 

6 

7 

0 

11 

73 

Oh  0m  58.848* 

n 

2 

1 

2 

20 

Oh  0m  10.158 

8 

2 

2 

0 

14 

Oh  0m  10.43s 

9 

2 

1 

0 

14 

Oh  0m  2.56s 

10 

2 

1 

0 

14 

Oh  0m  2.1s 

11 

2 

1 

0 

15 

Oh  0m  0.66s 
— 

12 

3 

2 

0 

23 

Oh  0m  2.92s 

13 

l** 

0** 

0** 

10 

Oh  0m  0.61s 

14 

3 

0 

2 

27 

Oh  0m  3.14s 

15 

2 

0 

2 

14 

Oh  0m  1.76s 

16 

4 

0 

3 

55 

Oh  0m  8.76s* 

17 

7 

0 

6 

. 

106 

Oh  8m  30.63s* 

18 

8 

0 

6 

82 

Oh  24m  29.65s* 

19 

13 

9 

0 

97 

llh  57m  12.7s 

20 

20 

10 

0 

258 

No  Solution 

*Not  solved  under  Standard  Conditions,  **  Equality  constraint 
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found.  This  could  have  been  done  only  with  extensive  trial-and-error  or  by  knowing  the 
solution  in  advance.  Problem  Nineteen  (MOC  97)  was  solved  without  modification,  under 
the  Standard  Conditions,  but  the  solution  time  was  nearly  12  hours  of  CPU-time. 

Problem  Twenty  has  a  MOC  of  258,  and  was  found  to  be  beyond  the  capacity  of 
the  algorithm.  Even  with  extensive  modification  to  the  standard  conditions,  and  with  the 
bounds  narrowed  to  10~3°  of  the  original  neighborhood  and  an  initial  solution  provided 
near  the  optimum,  the  algorithm  was  unable  to  find  a  solution. 

4-4  Overall  Evaluation 

The  benchmark  problems  in  this  set  explored  the  full  range  of  ability  of  the  Adaptive 
Simulated  Annealing  algorithm  in  both  dimensionality  and  level  of  constraint.  Overall, 
the  Adaptive  Simulated  Annealing  algorithm  found  excellent  solutions  to  seventeen  of  the 
twenty  benchmark  problems.  For  the  low  dimension,  lightly  constrained  problems,  the 
performance  of  the  algorithm  is  very  good.  For  these  problems  with  MOC  values  below 
50,  the  solutions  found  were  as  good  as  the  solutions  found  by  the  other  optimizers  and 
the  time  required  was  insignificant. 

The  performance  of  the  algorithm  on  problems  with  moderate  MOC  values  was  not 
as  good.  In  some  cases,  to  solve  problems  with  MOC  values  between  50  and  100,  only 
the  initial  conditions/ stopping  criteria  had  to  be  modified,  and  knowledge  of  the  solution 
was  not  necessary  in  advance.  Generally,  for  problems  with  MOC  values  between  50  and 
100,  the  optimizer  may  find  a  solution  with  some  “tinkering”,  or  may  require  hours  of 
CPU-time. 

In  some  problems  with  higher  MOC  values,  the  bounds  had  to  be  modified  signifi¬ 
cantly  and  the  optimum  had  to  be  known  before  the  algorithm  could  find  a  solution.  This 
result  suggests  a  possible  use  for  fine  tuning  a  solution  in  a  neighborhood  found  by  some 
other  optimizer.  However,  the  solution  found  for  problem  seventeen  was  not  nearly  as 
good  as  the  other  optimizers’  solutions,  suggesting  that  even  this  limited  application  may 
be  undesirable  for  problems  with  MOC  values  above  100.  For  the  problem  with  a  MOC 
value  above  200,  the  optimizer  was  unable  to  find  solution. 
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Analysis  of  these  results  was  used  to  draw  conclusions  about  the  effectiveness  of  us¬ 
ing  Simulated  Annealing  in  structural  optimisation  problems.  Chapter  Five  summarises 
the  entire  research  process;  addresses  the  conclusions  drawn  from  the  results  of  the  in¬ 
vestigation;  and  makes  suggestions  for  further  research  relating  to  Simulated  Annealing, 
non-linear  programming,  and  structural  optimisation. 


4-13 


V.  Summary,  Recommendations,  and  Conclusion 
5.1  Summary  of  the  Research 

This  research  was  conducted  to  investigate  the  advantages  and  disadvantages  of  using 
Simulated  Annealing  to  solve  structural  optimisation  problems.  Simulated  Annealing  has 
been  applied  to  many  types  of  optimisation  problems,  but  not  to  structural  optimisation 
until  this  research  was  conducted.  To  determine  the  applicability  of  Simulated  Annealing 
to  structural  optimisation  problems,  the  Adaptive  Simulated  Annealing  algorithm  was 
used  to  optimise  twenty  benchmark  problems.  The  success  or  failure  of  the  algorithm  in 
solving  these  benchmark  problems  is  the  basis  for  evaluation. 

5.1.1  Highlights  of  the  Research.  Eighteen  of  the  twenty  benchmark  problems  rep¬ 
resent  “real”  structural  optimisation  problems.  For  research  in  structural  optimisation, 
this  is  the  most  valid  type  of  problem,  but  the  largest  of  these  problems  only  had  eight 
variables.  To  test  the  ability  of  the  Simulated  Annealing  algorithm  in  higher  dimensions, 
two  high-dimension  non-linear  programs  were  added  to  the  set  of  structural  optimization 
problems.  These  two  problems  are  not  “real”  structural  optimization  problems,  but  they 
were  formulated  in  a  similar  manner  to  the  structural  optimization  problems,  and  thus  al¬ 
lowed  the  investigation  to  extend  to  what  may  be  considered  the  limits  of  the  algorithm’s 
capability. 

Variations  in  Initial  Conditions /Stopping  Criteria.  Variations  in  the  initial  condi¬ 
tions  and  stopping  criteria  can  greatly  impact  the  success  of  any  optimization.  The  first 
benchmark  problem  was  used  to  test  the  effects  of  variations  in  the  initial  conditions  and 
stopping  criteria.  The  algorithm  found  the  same  solution  under  each  variation,  so  the  effect 
of  these  variations  was  evaluated  by  comparing  the  amount  of  time  required  to  solve  the 
problem  under  each  variation.  Based  on  this  evaluation,  a  set  of  “Standard  Conditions” 
was  established  for  use  with  the  remaining  problems. 

Dimensionality  and  Constraint.  To  evaluate  the  effects  of  dimensionality  and  con¬ 
straint,  all  of  the  benchmark  problems  were  optimized  under  the  Standard  Conditions. 
Dealing  with  problems  having  many  variables  was  expected  to  be  a  weakness  of  this  algo¬ 
rithm.  However,  as  the  research  progressed  it  became  clear  that  the  constraints  imposed 


5-1 


on  the  solution  were  also  significant  in  determining  the  success  of  the  algorithm.  The  con¬ 
straints  may  make  the  feasible  region  very  small  compared  to  the  neighborhood  searched 
by  the  algorithm.  The  number  of  variables  and  the  level  of  non-linearity  of  the  constraints 
in  a  problem  determine  how  difficult  the  problem  is  to  solve  using  Simulated  Annealing.  A 
problem  containing  many  variables,  many  constraints,  and/or  highly  non-linear  constraints 
is  difficult  for  this  algorithm  to  optimize.  It  is  difficult  to  separate  and  assess  the  effects 
of  dimensionality  and  constraint  because  these  effects  interact. 

Measure  of  Complexity.  To  help  quantify  the  effects  of  dimensionality  and  constraint, 
a  Measure  of  Complexity  (MOC)  index  was  established.  This  measure  is  used  to  assign 
a  relative  score  to  each  non-linear  program,  based  on  the  non-linearity  of  the  objective 
function  and  constraints,  the  number  of  variables,  and  the  number  of  constraints.  It 
assigns  a  single-value  score  which  quantifies  the  overall  topology  of  the  problem,  giving  a 
relative  indication  of  how  difficult  the  problem  may  be  to  solve. 

Quality  of  Solution.  The  quality  of  the  solutions  found  by  an  algorithm  may  be  the 
most  important  criteria  for  evaluation.  In  this  investigation  the  algorithm  minimized  the 
value  of  the  objective  function,  and  the  lowest  value  which  met  the  constraints  was  the  best 
solution.  The  best  solutions  found  by  the  Adaptive  Simulated  Annealing  algorithm  were 
compared  to  the  best  solutions  found  by  four  other  optimizers  currently  used  in  structural 
optimization.  The  best  solutions  found  by  the  Adaptive  Simulated  Annealing  algorithm 
were  found  by  varying  the  initial  conditions  and  stopping  criteria,  as  necessary,  for  each 
individual  problem. 

5.1.2  Results.  The  Adaptive  Simulated  Annealing  algorithm  found  solutions  equiv¬ 
alent  to  the  other  optimizers  for  seventeen  of  the  twenty  benchmark  problems.  The  solution 
time  was  nearly  twelve  horns  for  one  of  these  optimizations,  but  was  insignificant  for  the 
other  sixteen  successful  optimizations.  The  initial  conditions  were  modified  as  necessary 
for  the  algorithm  to  find  the  best  solutions  to  these  problems,  but  advance  knowledge  of 
the  solution  was  not  required  to  make  these  modifications. 

The  algorithm  was  unable  to  solve  three  of  the  twenty  problems.  It  eventually  found 
solutions  to  two  of  these,  but  only  after  the  bounds  on  the  variables  were  modified  sig- 
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nificantly  and  an  answer  very  close  to  the  optimum  was  provided  as  an  initial  feasible 
solution.  Because  these  modifications  could  only  have  been  made  with  advance  knowledge 
of  the  solution,  the  algorithm  didn’t  really  solve  these  problems.  The  algorithm  was  unable 
to  find  a  solution  to  one  problem  even  after  modification  of  the  initial  conditions,  extensive 
modification  of  the  bounds,  and  an  initial  feasible  solution  very  near  the  optimum. 

In  these  problems,  the  Measure  of  Complexity  value  is  a  useful  tool  for  predicting  the 
success  of  the  algorithm.  MOC  values  below  fifty  predict  a  good  solution,  very  little  CPU¬ 
time,  and  few  modifications  to  the  initial  conditions/stopping  criteria.  Values  between  50 
and  150  predict  a  good  solution  only  with  modifications  to  the  initial  conditions/stopping 
criteria,  and/or  hours  CPU-time.  MOC  values  well  above  150  predict  that  the  algorithm 
will  not  solve  the  problem. 

5. 1.2.1  Most  Significant  Result.  Identification  of  the  limitations  of  the  algo¬ 
rithm  in  solving  constrained  problems  is  the  most  significant  result  of  this  research.  Previ¬ 
ous  investigations  suggested  that  high  dimensionality  might  limit  the  use  of  the  algorithm, 
but  limitations  on  the  level  of  constraint  had  not  been  addressed  in  the  literature. 

5.1.3  Evaluation  of  Applicability.  The  purpose  of  this  research  was  to  determine  if 
Simulated  Annealing  is  a  good  tool  for  structured  optimization  problems.  In  light  of  the 
results,  it  appears  that  Simulated  Annealing  has  only  limited  applicability  in  structural 
optimization.  “Real”  structural  optimization  problems  may  have  hundreds,  or  thousands, 
of  variables  and  many  highly  non-linear  constraints.  Simulated  Annealing  seems  best 
suited  to  low  dimension,  lightly  constrained  problems,  including  those  with  highly  non¬ 
linear  objective  functions. 

5.2  Recommendations  for  Further  Research 

In  large  structural  optimization  problems,  the  number  of  constraints  is  normally 
reduced  by  an  active-constraint  strategy.  Also,  the  number  of  variables  may  be  reduced  by 
linking  variables  together  in  sets  that  then  work  as  a  single  unit  (Kamat,  1993:6).  Under 
these  circumstances,  where  the  effective  MOC  value  is  reduced,  Simulated  Annealing  may 
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perform  as  well  as,  or  better  than,  other  optimisers.  Further  research  could  establish  the 
conditions  where  an  active-constraint  strategy  and  linking  variables  would  make  Simulated 
Annealing  effective  in  structural  optimization. 

Measure  of  Complexity  Index.  The  level  of  constraint  and  number  of  variables  are 
critical  to  the  success  of  Simulated  Annealing,  but  also  are  significant  for  other  optimizers. 
No  theoretical  basis  was  established  for  using  the  Measure  of  Complexity  in  this  research; 
it  seems  to  work,  so  it  was  used.  It  assigns  a  single  quantitative  value  to  the  overall 
topology  of  a  non-linear  program.  With  further  research,  this  measure  could  provide 
common  ground  for  comparing  the  performance  of  optimizers  with  significant  method-to- 
method  differences.  Theoretical  proof  of  the  validity  of  the  method  would  help  establish  it 
as  a  basis  for  comparison.  Consideration  should  be  given  for  weighting  periodic  functions, 
transcendentals,  and  other  non-polynomials. 

Parallel  Processing.  A  significant  part  of  the  time  required  to  evaluate  each  new 
solution  proposed  in  the  Simulated  Annealing  algorithm  is  used  to  check  feasibility.  Af¬ 
ter  a  solution  is  proposed,  the  variable  values  are  substituted  into  each  constraint.  The 
constraints  are  evaluated  sequentially  and,  if  all  of  them  are  met,  the  objective  function 
is  evaluated.  After  a  solution  is  proposed,  a  parallel  processor  could  check  all  of  the  con¬ 
straints  at  once.  This  would  significantly  reduce  the  time  required  for  the  calculations.  A 
parallel  processor  might  also  be  used  to  choose  the  variable  values  for  the  new  proposed 
solution.  In  this  way,  all  of  the  new  variables  could  be  selected  at  once,  then  the  new 
proposed  solution  could  be  evaluated. 

Decomposition.  A  non-linear  program  with  many  variables  could  be  partitioned  (in  a 
process  like  Rosen’s  partitioning  algorithm  or  Benders’  decomposition)  into  multiple  sub¬ 
problems  and  a  master  problem,  with  each  sub-problem  having  fewer  dimensions  than  the 
initial  problem  (Lasdon,  1970:358).  The  Simulated  Annealing  process  could  be  used  to 
solve  the  subproblems,  and  perhaps  the  master.  The  MOC  index  could  be  used  to  guide 
the  partitioning  process,  breaking  the  problem  up  into  manageable  pieces  for  SA  to  solve. 

Reannealing.  One  result  of  the  investigation  is  that  the  reannealing  process  may  im¬ 
prove  the  speed  of  the  Adaptive  Simulated  Annealing  algorithm,  along  with  the  expected 


5-4 


result  of  improving  the  accuracy  of  the  solution.  Analysis  of  the  reason  for  this  behavior, 
and  further  exploitation  of  this  advantage  would  be  useful  in  the  development  of  Adap¬ 
tive  Simulated  Annealing  in  many  applications.  Dr.  Ingber  has  expressed  an  interest  in 
supporting  further  research  in  this  area. 

It  also  seems  possible  that  the  algorithm  may  be  able  to  reduce  the  actual  upper  and 
lower  bounds  on  variables,  to  reduce  the  search  neighborhood.  If  this  could  be  done  in 
coqjunction  with  reannealing  (or  quenching),  it  may  further  speed  the  solution.  A  related 
idea  would  be  to  partition  the  solution  space,  and  search  in  each  partition  separately.  In 
either  case,  provisions  would  have  to  be  made  to  ensure  that  the  global  optimum  would  be 
retained  within  the  modified  bounds. 

Fine-Tuning  of  Solutions.  Further  research  might  identify  the  circumstances  where 
Simulated  Annealing  could  be  used  for  fine-tuning  solutions  found  by  other  optimizers. 

Random  Number  Seed.  Further  research  may  reveal  ways  to  improve  the  quality  of 
the  solution  or  the  solution  time  by  modifying  the  random  number  seed. 

Optimizing  Initial  Conditions.  Adaptive  Simulated  Annealing  has  an  option  for  self- 
optimizing  the  initial  conditions  of  a  subset  of  the  non-linear  program,  then  providing  these 
initial  conditions  for  the  full  optimization.  This  is  a  process  of  annealing  the  annealing 
process  and  is  considered  to  be  CPU-intensive.  Perhaps  a  linear  model  of  the  effects  of 
variations  in  the  initial  conditions  or  an  application  of  the  MOC  index  could  be  used  to 
predict  the  best  initial  conditions  for  a  given  non-linear  program.  This  prediction  could 
be  used  to  provide  initial  conditions  for  a  full  optimization. 

5.3  Conclusion 

The  applicability  of  Simulated  Annealing  to  structural  optimization  problems  ap¬ 
pears  to  be  limited.  The  effects  of  high  dimensionality  and  high  levels  of  constraint  over¬ 
whelm  the  random  search  process  of  this  algorithm.  While  this  algorithm  is  not  well  suited 
to  this  application,  it  shows  promise  for  further  development  in  many  other  fields.  As  com¬ 
puter  hardware  becomes  more  capable,  the  applicability  of  this  algorithm  becomes  broader 
and  further  research  is  justified. 
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Appendix  A.  Making  ASA  Run 


The  ASA  algorithm  is  set  up  to  make  the  user.c  file  a  template  for  the  user  to  modify 
for  the  individual  nonlinear  programming  (NLP)  problem. 

a.  The  user  modifies  the  options  as  necessary,  or  allows  the  algorithm  to  run  the 
default  values. 

b.  The  user  defines  the  number  of  parameters  (dimensions)  in  the  NLP.  This  allocates 
storage  space  for  the  parameter  arrays,  and  defines  D  in  the  Temperature  Ratio  Scale 
function. 

c.  The  user  sets  upper  and  lower  bounds  for  each  parameter.  This  step  is  required 
for  each  parameter,  even  if  the  NLP  does  not  define  the  bounds.  ASA  uses  these  values 
as  B  and  A  in  the  Parameter  Generating  PDF.  The  values  of  each  parameter  are  chosen 
from  this  range. 

d.  The  user  defines  constraints,  if  applicable.  These  can  be  built  into  the  algorithm 
with  an  IF  statement  (i.e.  if  constraint  x  is  met),  prior  to  evaluating  the  objective  function. 

e.  The  user  defines  the  objective  function.  In  user.c  the  value  of  “summ”  is  returned 
to  the  optimizer,  so  the  objective  function  is  set  equal  to  “summ” .  The  objective  function 
and  constraints  must  be  explicitly  defined  for  ASA. 

In  UNIX,  the  user  can  use  the  “make”  command.  This  command  compiles,  links, 
and  runs  all  the  necessary  files  according  to  the  Makefile  command  (provided  with  the 
ASA  code).  The  important  files  are: 

a.  user.c  which  the  user  modifies  with  options,  constraints,  and  objective  function. 

b.  t iser.h  which  contains  the  header  files  for  user.c 

c.  asa.c  which  contains  the  SA  optimizer 

d.  asa.h  which  contains  the  header  files  for  asa.c 

e.  asaopt  (if  used)  which  defines  the  options  chosen 

f.  asaout  which  is  the  default  output  file 
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Appendix  B.  Standard  Conditions  for  ASA 

Standard  Adaptive  Simulated  Annealing  initial 
conditions  and  stopping  criteria  for  all  benchmark  problems 


OPTIONS.PILE  -  0 

HAVE.ANSI  -  1 

I0.PB0T0TYPES  -  i 

TIME.CALC  «  1 

INT.LONG  »  1 

INT.ALLOC  «  0 

SHALL.FLOAT  *  le-18 

MIN.DODBLE  >  le-18 

MAX.DOUBLE  -  le+18 

EPS.DOUBLE  »  le-18 

NO_PARAM_TEMP_TEST  =  0 

NO_COST_TEMP_TEST  »  0 

SELF.OPTIHIZE  =  0 

OPTIONAL.DATA  -  0 

ASA.PRIMT  -  1 

AS A _ OUT  *  asa_out 

USER_ASA_OUT  -  0 

AS A_PRINT_ INTERMED  *  1 

ASA_PRINT_MORE  =  0 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 

OPTIOHS->LIMIT_INVALID_GEHERATED_STATES  =  1000 

OPTIONS->ACCEPTED_TO_GENERATED_RATIO  *  0.0001 

OPTIONS->COST_PRECISION  =  le-08 

OPTIONS->MAIIMUM_COST_REPEAT  a  2 

OPTIONS->NUMBER_COST_SAMPLES  a  2 

OPTIONS->TEMPERATURE_RATIO_SCALE  a  le-05 

OPTIONS->COST_PARAMETER_SCALE  a  i 

OPTIONS-  >TEMPERATORE_ ANNEAL .SCALE  =  100 


Standard  Bounds:  0  lower,  20  upper 


B-l 


Standard  Conditions  Continued: 


OPTIONS->USER_INITIAL_COST_TEMP  -  0 
OPTIONS->IHCLUI>E_INTEGER_PARAMETERS  -  0 
OPTIOMS->USER_INITIAL_PARAMETERS  -  1 
OPTIONS->IHITIAL_PARAMETER_ TEMPERATURE  -  1 
OPTIONS- >RATIO_TEMPERATURE_SCALES  -  0 
OPTIONS->USER_INITIAL_PARAMETERS_TEMPS  *  0 
OPTIONS- >TESTING_FREQOEHCY_MODULUS  =  100 
OPTIONS- >ACTIVATE_REANNEAL  -  0 
OPTIONS- >REANNEAL_RESC ALE  »  10 
OPTIONS- >MAXIMOM_REANNEAL_INDEX  =  50000 
OPTIONS->DELTA.Z  -  0.001 
OPTIONS- >DELTA_PABANETESS  =  0 
OPTIONS->CORVATURE_0  -  0 
OPTIONS- >QUENCH_PARAMETERS  =  0 
DPTIONS->QOENCH_COST  *  0 
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Appendix  C.  Benchmark  Problems  and  ASA  Solutions 

BEICHMARX  PROBLEM  *1 

Constraint* : 

gl  -  (-2  *  x[0]  +  x[l]  ♦  1); 

g2  -  <-x[0]  ♦  2  *  x[l]  -1); 

g3  -  (x[0]  *  xCO]  -  2  *  x[0]  -  2  *  x[l]  +  1); 

Objective  Function: 
sum  ■  (10  •  x[0]  +  x[l]) 

Initial  Conditions: 

OPTIOMS->LIMIT_ACCEPTAKCES  *  1000 
OPTIOHS->LIMrr_IHVALID_GEMERATED_STATES  =  1000 
OPTIOHS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0HS->C0ST_PRECISI0M  *  le-8 
OPTIOHS->MAXIMUM_COST_REPEAT  »  2 
OPTIOHS->KUMBER_COST_SAMPLES  *  2 
OPTIOHS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index. v  paxam_minimum  paiam.maximum  param.  value  param.type 
0  0  10  1-1 
10  10  1-1 

Results : 

number .generated  *  33463,  *number_accepted  *  1001 
best_generated_state->parameter[0]  =  0.6505103 
best_generated_state->parameter[l]  =  0.1010205 

H0RMAL.EZIT  exit.status  =  0 

final. cost  =  best_generated_8tate->cost  =  5.606123 
asa_end:time:  Oh  0m  21.53s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 
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BKICBMA1K  PROBLEM  #1,  MODIFIED  LIMIT  ACCEPT AMCES 


Constraints : 

gl  -  (-2  *  x[0]  +  x[l]  +  i); 

g2  -  (-x[0]  ♦  2  *  x[l]  -1); 

g3  ■  (x[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[l]  ♦  i); 

Objective  Function: 
stum  ■  (10  *  x[0]  +  x[l]) 

Initial  Conditions: 

OPTIOMS->LIMIT_ACCEPTAMCES  *  10000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  >  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  -  0.0001 
0PTI0HS->C0ST_PRECISI0N  »  le-8 
OPTIOHS->MAXIMOM_COST_REPEAT  »  2 
OPTIONS- >NUHBER_ COST .SAMPLES  ■  2 
OPTIONS-MJSER.INITIAL.PARAMETERS  «  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index _v  param.minimuni  param_maximum  pur  am. value  param.type 
0  0  10  1-1 
10  10  1-1 

Results : 

number .generated  *  769257,  ^number .accepted  3  1046 
best.generated_8tate->parameter  [0]  =  0.5505103 

best_generated_state->parameter[l]  =  0.1010205 

COST.REPEATING  exit.status  3  3 

final.cost  =  best_generated_state->co8t  =  5.606123 
asa_end:time:  Oh  8m  33.63s;  incr:  Oh  Om  Ob 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-2 


BENCHMARK  PROBLEM  #1,  MODIFIED  LIMIT  INVALID  GEM  STATES 


Constraints : 

gl  -  (-2  *  x[0]  +  x[l]  +  1); 

g2  -  (-x[0]  +  2  *  x[l]  -1); 

g3  -  (x[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[l]  +  1); 

Ob j active  Function: 
sums  ■  (10  *  x[0]  +  x[l]) 

Initial  Conditions: 

OPTIONS- >LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_IH?ALID.GEHERATED_STATES  =  10000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  *  0.0001 
OPTIONS- >COST_PRECISION  =  la-8 
OPTIONS- >MAXIMUM_COST_REPEAT  *  2 
OPTIONS->NUMBER_COST_SAMPLES  ■  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  *  0 

index _v  param_minimum  param_maximum  param.  value  param.type 
0  0  10  1-1 
10  10  1-1 

Results : 

number .generated  =  33463,  +number_accepted  =  1001 
best_generated_state->parameter[0]  =  0.6605103 
beat_generated_8tate->paxameter [1]  =  0 . 1010206 

NORMAL.EXIT  exit.status  =»  0 

linal.cost  *  best_generated_state->cost  =  5.606123 
asa_end:time:  Ob  Om  21.48s;  incr:  Ob  Om  0.01s 

BEST  COST  WITH  MODIFIED  PARAMETERS  6.606123 


C-3 


BENCHMARK  PKOBLEM  tl,  MODIFIED  ACCEPTED  TO  GEMEKATED  RATIO 


Constraints : 

gl  -  (-2  *  x[0]  +  x[l]  +  1); 

g2  «  <-x[0]  +  2  *  xCl]  -1); 

g3  3  (x[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[l]  +  1); 

Objective  Function: 
summ  «  (10  *  x[0]  +  x[l]) 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  3  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  3  1000 
OPTIONS->ACCEPTED_TO_GEHERATED_RATIO  »  le-08 
0PTI0NS->C0ST_PRECISI0N  *  le-8 
OPTIONS->MAXIMUM_COST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  *  2 
OPTIOMS->OSER_IHITIAL_PARAMETERS  *  1 
OPTIONS- >ACTIVATE_REANNEAL  *  0 

index _v  pamm  mi n i mnm  param_maximtLm  param_ value  param_type 
0  0  10  1-1 
10  10  1-1 

Results : 

nnmber.genexated  *  33453,  *number_accepted  =  1001 
best_generated_8tate->parameter[0]  =  0.5505103 
best_generated_state->paraneter[l]  =  0.1010205 

NORMAL.EZIT  exit.status  3  0 

final.cost  3  best_generated_state->cost  =  5.606123 
asa_end:time:  Oh  Om  21.47s;  incr:  Oh  Om  Ob 


BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


BENCHMARK  PROBLEM  *1.  MODIFIED  COST  PRECISIOH 


Constraints : 

gl  -  (-2  *  x[0]  ♦  x[l]  +  1); 

g2  -  (-x[0]  +  2  *  x[l]  -1); 

g3  ■  Cx[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[l]  +  i); 

Ob j active  Function: 
sum  -  (10  *  xCO]  +  x[l]) 

Initial  Conditions: 

OPTIOVS->LIMIT.iCCEPTiHCES  =  1000 
OPTIOHS->LIMIT_IHVALID.GEliERATED_STATES  =  1000 
OPTIOHS->ACCRPTED_TO_GEHERATED.RATIO  -  0.0001 
0PTI0HS->C0ST_PRECISI0H  *  0.0001 
0PTI0HS->M1IIMUM_C0ST_REPEAT  »  2 
OPTIOIS->HUMBER.COST_SAMPLES  =  2 
OPTIOHS->USER_HfITIAL_PARAMETERS  «  1 
OPTIOHS->ACTIVATE_REAHHEAL  *  0 


index _v  paraa_minimun  param_maximum  param_ value  param_type 
0  0  10  1-1 
10  10  1-1 

Results : 

number .generated  =  33453,  ♦number .accepted  =  1001 
best_generated_8tate->parameter[0]  =  0.5505103 
best_generated_8tate->parameter[l]  =  0.1010205 

NORMAL.EXIT  exit.status  =  0 

final. cost  =  best_generated_8tate->cost  =  5.606123 
asa_end:time:  Oh  Om  21.33s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-5 


BEICHMAAK  PROBLEM  «1.  MODIFIED  MAX  COST  REPEATS 


Constraint* : 

gl  -  (-2  *  x[0]  ♦  x[l]  +  1); 

g2  -  (-x[0]  +  2  *  x[l]  -1); 

g3  »  (x[0]  *  x[0]  -  2  *  x[0]  -  2  *  x£l]  +  1); 

Ob j active  Function: 
slum  ■  (10  *  x[0]  +  x[l]) 

Initial  Conditions : 

OPTIOHS->LIMIT_ACCEPTAHCES  *  1000 
OPTIOJfS->LIMIT_IMVALID_GENERlTED_STATES  »  1000 
0PTI0HS->ACCEPTED_T0_GE1(ERATED .RATIO  -  0.0001 
0PTI0HS->C0ST.PRECISI0N  »  la-8 
0PTI0HS->MA1IMUM_C0ST_REPEAT  -  5 
0PTI0HS->HUMBER.C0ST_SAMPLES  »  2 
OPTIONS->USER_INITIAL_PARAMETERS  »  1 
OPTIONS->ACTIVATE_REAHNEAL  »  0 

indax.v  param_mini nmm  par am.max imam  pai.un.  value  param_type 
0  0  10  1-1 
10  10  1-1 

Result s : 

number .generated  *  33483,  *number .accept ed  =  1001 
be 8 1 _ generated. state - >par amet er [0]  *  0.5805103 
best_generated.state->parameter[l]  =  0.1010205 

N0RMAL.EXIT  exit.status  =  0 

final.cost  =  best_generated_8tate->cost  =  5.606123 
asa_end:time:  Oh  0m  22.31s;  incr:  Oh  0m  0.01s 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-6 


BENCHMARK  PROBLEM  #1,  MODIFIED  BOMBER  COST  SAMPLES 


Constraints : 

gl  -  (-2  *  x[03  +  x[l]  +  1); 

g2  -  (-x[0]  +  2  *  x£l]  -1); 

g3  -  (x[0]  *  xCO]  -  2  *  x[0]  -  2  *  x£l]  +  1); 

Objoctiva  Function: 

■aim  ■  (10  *  x[0]  +  xCl] ) 

Initial  Conditions: 

OPTIONS->LIMIT_iCCEPTAHCES  =»  1000 
OPTIOIS- >LIMIT_ INVALID .GENERATED .STATES  =»  1000 
OPTIOMS->ACCEPTED_TO_GEHERATED_RATIO  ■  0.0001 
0PTI0HS->C0ST_PRECISI0H  *  le-8 
OPTIONS- >MAIIMOM_COST_REPEAT  »  2 
OPTIONS- > NUMBER. COST .SAMPLES  =  5 
OPTIONS->USER_INITIAL_PARAMETERS  *  1 
OPTIONS- >ACTI¥ATE_REANNEAL  =  0 

index_v  paramjninimuin  param.maximum  param_ value  param.type 
0  0  10  1-1 
10  10  1-1 

Results : 

number .generated  =  3155,  *number_accepted  =  1001 
best_generated_8tate->parameter[0]  =  0.5505103 

be8t_generated_state->parameter[l]  =  0.1010205 

HORMAL.EXIT  exit. status  =  0 

final .cost  =  best _generated_8tate-> cost  =  5.606123 
asa_end:time:  Oh  Om  1.99s;  incr:  Oh  Om  0.01s 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-7 


BEMCHMARK  PROBLEM  «1 


MODIFIED  USEE  HIT  P1EAMS  (FALSE) 


Constraint a : 

gl  -  (-2  *  x[0]  ♦  x[l]  ♦  1); 

g2  -  (-x[0]  +  2  *  x[l]  -1); 

g3  -  (x[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[l]  +  i); 

Objective  Function: 
sunn  •  (10  *  x[0]  +  x[l]) 

Initial  Conditions: 

OPTIOHS->LIMIT_ACCEPTAHCES  >  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  *  1000 
OPTIONS->ACCEPTED_TO_GEHERATED_RATIO  »  0.0001 
0PTI0HS->C0ST_PRECISI0N  »  la-8 
OPTIONS->MAXIMUM_COST_REPEAT  »  2 
OPTIONS->NUMBER_COST_SAMPLES  -  2 
OPTIONS- >USER_ INITIAL .PARAMETERS  »  0 
OPTIONS->ACTIVATE_REANNEAL  »  0 

index. v  par am.nin imam  param.maximum  param.  value  param.type 
0  0  10  1-1 
10  10  1-1 

Results : 

number .generated  =  29756,  *number_accepted  =  1001 
best_generated_atate->parameter[0]  =  0.5505103 
best_generated_state->parameter[l]  =  0.1010205 

COST.REPEATING  exit.status  *  3 

final.cost  =  best_generated_8tate->coBt  =  5.606123 
a8a_end:time:  Oh  Om  20.09s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-8 


BEICHMA&K  PROBLEM  «1,  MODIFIED  ACTIVATE  RE* WEAL  (TRUE) 


Constraints : 

gl  ■  (-2  *  x[0]  +  x[l]  +  1); 

g2  -  (-x[0]  +  2  *  x[l]  -1); 

g3  »  Cx[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[l]  +  1); 

Objective  Function: 
sum  ■  (10  *  x[0]  +  x[l]) 


Initial  Conditions: 

OPTIONS-  >LIMIT_ ACCEPTANCES  =>  1000 
OPTIONS->LIMIT_INVALID.GENERATED_STATES  =  1000 
0PTI0HS->ACCEPTED_T0.6ENERATED_RATI0  »  0.0001 
OPTIONS- >C0ST_PRECISI0N  *  la-8 
OPTIONS- >MAXIMUM_COST_REPEAT  *  2 
OPTIONS->NUMBER_COST_SAMPL£S  *  2 
OPTIONS- >USER_ INIT I AL .PARAMETERS  »  1 
OPTIONS->ACTIVATE_REANNEAL  *  1 


index_v  paxam.minimum  par am. maximum  pax am_ value  param.type 
0  0  10  1-1 
10  10  1-1 

Results : 

number .generated  =  14912,  *number. accepted  =  900 
be8t.generated.state->parameter[0]  =  0. 650510? 

best_generated_state->parameter [1]  =  0.101020b 

C0ST.REPEATIN6  exit .status  =  3 

final. cost  =  best_generated_state->cost  =  5.606123 
asa_end:time:  Oh  Om  9.15s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-9 


BENCHMARK  PROBLEM  *1,  MODIFIED  SEED  VALUES 
Constraints : 

gl  -  (-2  *  x[0]  +  x[l]  +  1); 

g2  -  (-x[0]  +  2  *  x[l]  -1); 

g3  -  (x[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[i]  +  i); 

Objective  Function: 
stum  **  (10  *  x[0]  +  x[l]) 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  »  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0NS->C0ST_PRECISI01I  *  le-8 
DPTIONS->MAIIMUM_COST_REPEAT  =  2 
OPTIONS- > NUMBER. COST .SAMPLES  =  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index.v  param_minimum  paran_maximum  par am_ value  param_type 
0  0  10  0  -1 
10  10  0-1 

Results : 

number.generated  =  3735,  *number_accepted  =  1001 
be8t_generated_state->paraaetex[0]  =  0.5505103 

be8t_generated_8tate->parameter[l]  =  0.1010205 

NORMAL.EXIT  exit-status  =  0 

final-cost  =  beat _generated.state-> cost  =  5.606123 
a8a-end:time:  Oh  Om  2.55s;  incr:  Oh  Om  0.01s 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-10 


BENCHMARK  PROBLEM  *1.  MODIFIED  BOUNDS  (0  -  20) 


Constraints : 

gl  -  (-2  *  r[0]  +  x[l]  +  1); 

g2  »  (-x[0]  +  2  *  x[i]  -1); 

g3  *  (x[0]  *  x[0]  -  2  *  xCO]  -  2  *  x[i]  +  i); 

Objective  Function: 
smmn  *  (10  *  x[0]  ♦  x[l]) 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  *  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIOHS->ACCEPTED_TO_GENERATED .RATIO  *  0.0001 
0PTI0NS->C0ST_PRLCISI0N  *  le-8 
0PTI0NS->MAIIMUM_C0ST_REPEAT  *  2 
OPTIONS- >NUMBER_COST_SAMPLES  =  2 
DPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index _v  param.minimum  param.maximum  par am_ value  param_type 
0  0  20  1  -1 

1  0  20  1  -1 

Results : 

number .generated  =  57787,  *number .accepted  =  1001 
best.generated_8tate->parameter[0]  =  0.5505103 
be8t_generated_state->parameter[l]  =  0.1010205 

NORMAL.EXIT  exit.status  =  0 

final.cost  =  best_generated_state->cost  =  5.606123 
a8a.end:time:  Oh  Om  38.4s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


C-ll 


BENCHMARK  PROBLEM  *1,  MODIFIED  BOUIDS  (0  -  100) 


Constraints : 

gl  -  (-2  *  x[0]  +  x[l]  +  1); 

g2  -  (-x[03  +  2  *  x[l]  -1); 

g3  -  (x[0]  *  x[0]  -  2  *  x[0]  -  2  *  x[l]  +  1); 

Objective  Function: 
soma  ■  (10  *  x[0]  +  x[l]) 

Initial  Conditions: 

OPTIQNS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  *  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  *  0.0001 
0PTI0NS->C0ST_PRECISI0N  =  le-8 
OPTIOHS->MAIIMOM_COST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  =  2 
OPTIONS- >USER_ INITIAL .PARAMETERS  *  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index. v  paxamjainimum  param_maximtim  paras. value  param_type 
0  0  100  1  -1 
10  100  1  -1 

Results : 

number _gener at ed  =  0,  *number_accepted  =  0 
best.generated_state->parameter[0]  =  0 

best .generated. state->parameter[l]  =  0 

TOO.MANY.INVALID.STATES  exit.status  =  4 
final.cost  =  best_generated_8tate->cost  =  0 
asa_end:time:  Oh  Om  0.23s;  incr:  Oh  Om  Os 


BEST  COST  WITH  MODIFIED  PARAMETERS  5.606123 


BENCHMARK  PROBLEM  §2,  STUDIED  COVDITIOMS 


Constraints : 

gl  »  (.124  *  sqrt(l  +  x[l]  *  x[l])  *  (8/x[0]  + 
l/(xCO]  *x[l])  -  1); 

g2  »»  (.124  *  8qrt(l  +  x[l]  *  x[l])  *  (8/x(0]  - 
1/  (x  [0]  *x[l])  -  1); 

Objective  Function: 

sum  >  (x[0]  *  sqrt(l+  x[l]  *  x[l]) 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_BATIO  *  0.0001 
0PTI0NS->C0ST_PRECISI0N  =  le-8 
0PTI0NS->MAIIMUM_C0ST_REPEAT  =  2 
0PTI0NS->NUMBER_C0ST_SAHPLES  *  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index _v  param.minimum  param_maxiinim  param_ value  param_type 
0  0.2  4  4  -1 

1  0.1  1.6  1.6  -1 

Results : 

number .generated  ~  3482,  ^number. accepted  =  1001 
best.generated.state->parameter[0]  =  1.419946 

best_generated_8tate->parameter[l]  =  0.3610656 

N0RMAL.EXIT  exit. status  a  0 
final.cost  =  best_generated_state->cost  =  1.509699 
asa_end:time:  0b  0m  1.77s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  CONDITIONS  1.508653 


C-13 


BENCHMARK  PROBLEM  *3,  STUDIED  COIDITIOIS 


Constraints : 

gl  •  -1  +  16/(x[l]  +  0.25  *  x[0]) ; 

g2  «  -1  +  sqrt(3)/(3  *  x[0])  +  2/(x[l]  +  0.26  *  x[0]); 

Objective  Function: 

Siam  *  4.0  *  x[0]  +  x[l] 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  *>  1000 
0PTI0NS->LIMIT_INYALID_GENERATED_ST1TES  *  1000 
0PTI0NS->ACCEPTED.T0.GENERATED_RATI0  =  0.0001 
0PTI0NS->C0ST.PRECISI0N  -  le-8 
0PTI0NS->MAIIMUM_C0ST_REPEAT  =  2 
OPTIONS- >NUMBER_C0ST_SAMPLES  =  2 
OPTIONS- >USER_ INITIAL. PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index. v  param.minimum  par am.max imnm  param. value  param_type 
0  0  20  1  -1 

1  0  20  1  -1 

Results : 

number .generated  =  3589,  *number .accepted  =  1001 
best_generated_8tate->parameter[0]  =  0.6598288 

best_generated_state->parameter[l]  =  15.83505 


N0RMAL.EIIT  exit .status  =  0 

final. cost  ■  best_generated_8tate->cost  =  18.47436 
a8a_end:time:  Oh  0m  1.84b;  incr:  Oh  0m  0b 

BEST  COST  WITH  MODIFIED  CONDITIONS  18.47436 


C-14 


BENCHMARK  PROBLEM  *4,  STUDIED  COIDITIOIS 


Constraint : 

gl  ■  81/  pov(x[0] ,3)  ♦  37/  pow(x[l] ,3)  +  19/pov(x[2] ,3)  + 
7/pov(x[3] ,3)  ♦  l/pos(x[4] ,3)  -1; 

Objective  Function: 

sum  ■  0.0624  *  (x[0]  +  x[l]  +  x[2]  +  z[3]  +  x[4]) 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
0PTI0HS->LIMIT_IMVALID.GEHERATED.STATES  =  1000 
0PTI0NS->ACCEPTED_T0_GENERATED_RATI0  *  0.0001 
OPTIOHS->COST_PRECISION  =  le-8 
OPTIONS- >MAIIMUM_C0ST_REPEAT  =  2 
OPTIONS- >NUMBER_COST_SAMPLES  =  2 
OPTIONS- >DSEE_ INITIAL .PARAMETERS  a  i 
OPTIONS- >ACTIVATE_REANNEAL 


index.v 

pa-ram  tniwimrun  puram  irmri nmm  pay »»  t»1  no 

param.type 

0 

0 

20 

1 

-1 

1 

0 

20 

1 

-1 

2 

0 

20 

1 

-1 

3 

0 

20 

1 

-1 

4 

0 

20 

1 

-1 

Results : 

*number_generated  =  17831,  *number_accepted  =  1001 
best_generated_state->paraaeter[0]  =  6.019731 

best_generated_state->parameter[l]  =  5.236718 

be8t_generated_8tate->parameter[2]  =  4.539208 

best_generated_state->parameter[3]  =  3.547769 

best_generated_state->paraaeter[4]  =  2.134679 


NORMAL.EIIT  ex it .status  =  0 
final. cost  =  best_generated_state->cost  =  1.340234 
asa_end:time:  Ob  Om  22.32s;  incr:  Ob  Om  0.01s 


BEST  COST  WITH  MODIFIED  CCNDITIONS  1.340036 


C-15 


BENCHMARK  PROBLEM  #4,  EEGiTITE  LOWER  BQOVD 


Constraint : 

gl  »  61/  pov(x[0] ,3)  +  37/  poe(x[l],3)  +  19/poe(x[2] ,3)  + 
7/pov(x[3] ,3)  +  l/po«(z[4] ,3)  -1; 

Objective  Function: 

Slum  ■  0.0624  *  (z[0]  +  x[l]  +  z[2]  +  x[3]  +  x[4]) 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  «  1000 
OPTIONS->LIMIT_INVALID_GENERATED.STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  *  0.0001 
0PTI0NS->C0ST_PRECISI0N  •  le-8 
OPTIONS->MAXIMOM_COST_REPEAT  *  2 
OPTIONS- > NUMBER. COST .SAMPLES  =  2 
OPTIONS->OSER_INITIAL_PARAMETERS  »  1 
OPTIONS- >ACTIVATE_REANNEAL 

indei_v  param_minimum  param_maximum  param_ value  param_type 


0 

-20 

20 

1 

-1 

1 

-20 

20 

1 

-1 

2 

-20 

20 

1 

-1 

3 

-20 

20 

1 

-1 

4 

-20 

20 

1 

-1 

Results : 

♦number .generated  -  16548,  *nuaber .accepted  =  1001 
best_generated_state->parameter[0]  =  1.286e-14 

best_generated_state->parameter  [1]  =  1.286e-14 

best_generated_state->parameter[2]  -  1.286e-14 

best _generated_8tate->parameter [3]  =  1 . 286e- 14 

best_generated_state->parameter[4]  =  i.286e-14 

NORMAL.EXIT  exit.statu 

final. cost  =  best.gener  state->coat  =  -6.24 
asa_end:time:  Oh  Om  15.74b,  incr:  Oh  Om  0.01s 

BEST  COST  WITH  MODIFIED  CONDITIONS  1.340036 


C-16 


BENCHMARK  PROBLEM  •  6,  STUDIED  COVDITIOES 
Constraint : 

gi  -  -x[0]*x[l]*x[2]  ♦  125; 

Objective  Function: 

snan  ■  20*x[l]*x[2]  +  30*x[0]*x[2]  ♦  15*x[0]*x[l]  ; 

Initial  Conditions: 

OPTIOMS->LIMIT_iCCEPTiMCES  «  1000 
OPTIOHS->LIMIT_IHVALID_GENERATED_STATES  »  1000 
0PTI0NS->ACCEPTED_T0_GENERATED_R1TI0  =  0.0001 
0PTI0NS->C0ST_PRECISI0N  =  la-8 
OPTIONS->KAIIMUM_COST_REPEAT  «  2 
0PTI0HS->HUMBEE_C0ST_S1MPLES  »  2 
QPTIOHS->OSER_INITIAL_PARAMETERS  *  1 
OPTIONS- >ACTIVATE_REANNEAL  »  0 

index. v  parameter.minimum  parameter  .maximum.  par am_ value  param_type 


20 

1 

-1 

20 

1 

-1 

20 

1 

-1 

Results : 

number .generated  =  6342,  *number_accepted  =  1001 
be8t_generated_state~>parameter[0]  *  4.72971 

best_generated_state->parameter[l]  =  6.53976 

best_generated_state->parameter[2]  =  4.041359 

CQST.REPEATING  exit.status  *  0 
final. cost  *  best_generated_8tate->C0Bt  =  1565.991 
asa_end:time:  Oh  0m  3.52s;  incr:  Oh  0m  0.01s 

BEST  COST  UITH  MODIFIED  CONDITIONS  1560.129 
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BENCHMARK  PROBLEM  •  6,  MODIFIED  INVALID  GEBERATED  STATES 


Constraint* : 

gl  »  27.0/(x[0]  *  pow(x[l],2)  *  x[2] )  -1; 
g2  -  397 . 5/ (x [O]  *  pos(x[l],2)  *  pos(x[2] ,2))  -1; 
g3  •  1.93  *  pos(x[3] ,3)/(x[l]  *  x[2]  *  pos(x[5] ,4)) ; 
g4  »  1.93  *  pow(x[4] ,3)/(x[l]  *  x[2]  *  pow(x[6] .4)) ; 
gS  »  sqrt(S55025.0  *  pow(x[3] ,2)/(pow(x[i] ,2)  * 
pow(x[2],2)  +  16 . 9E6) / (0 . 1  *  pow(x[6],3))  -  1100.0; 
g6  ■  sqrt (555026 . 0  *  pow(x[4] ,2)/(pow(x[l] ,2)  * 
pow(x[2],2)  +  157.5E6)/(0.1  *  pow(x[6],3))  -850.0; 
g7  *  x[l]  *  x[2]  -  40; 
g8  *  6  -  x[0]/x[l] ; 
g9  »«  x[0]/x[l]-  12; 
g24  -  (1.5  *  x[5]  +  1 . 9) /x  [3]  -  1; 
g26  -  (1.1  *  x[6]  +1.9)/x[4]  -  1; 

Constraints  10  thru  23  handled  by  defining  bounds 
(below)  on  variables 

Objective  Function: 

8unm  *  (0.7864  *  x[0]  *  x[l]  *  x[l])  *  (3.3333  * 
x[2]  *  x[2]  +  14.9334  *  x[2]  -  43.0934)  -  (1.508 
*  x[0])  *  (x[5]  *  x[5]  +  x[6]  *  x[6])  + 

7.477  *  (x[5]  *  x[5]  *  x[5]  +  x[6]  *  x[6]  *  x[6])  + 
0.7864  *  (x[3]  *  x[6]  *  x[5]  +  x[4]  *  x[6]  *  x[6]); 


Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  *  1000 
OPTIOHS->LIMIT_IMVALID_GENERATED_STATES  =  10000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0HS->C0ST_PEECISI0M  =  le-8 
OPTIONS->MAIIMUM_COST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  =  2 
OPTIOMS->USER_IHITIAL_PABAMETERS  =  1 
OPTIONS- >ACTIVATE_RE ANNEAL  =  0 


index_v 

param_minimum  pax am. 

.maximum 

param. value  param_type 

0 

2.6 

3.6 

3.1 

-1 

1 

0.7 

0.8 

0.75 

-1 

2 

17 

28 

22.5 

-1 

3 

7.3 

8.3 

7.8 

-1 

4 

7.3 

8.3 

7.8 

-1 

5 

2.9 

3.9 

3.4 

-1 

6 

5 

5.5 

5.25 

-1 
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Results : 

number .generated  *  12179,  *nnmber_accepted  3  1001 


be8t_generated_Btate->paramater [0]  *  3.500005 

b«8t_g«iiaratad_state->parameter[l]  3  0.7000001 

baat_ganaratad_8tata->paramatar [2]  ■  17 

ba8t_ganaratad_state->paramater [3]  3  7.300018 

be8t_generated_8tate->parameter [4]  3  7.715332 

bast_ganaratad_8tate->parafflater [5]  ■  3.350215 

best_generated_state->parameter [6]  3  5 . 286655 


NORMAL.EXIT  exit.Btatus  3  0 

final. cost  =  bast .generated. state->co8t  3  2994.345 
asa_eitd:time:  Oh  On  58.84s;  incr:  Oh  Om  0.02s 

BEST  COST  WITH  MODIFIED  CONDITIONS  2994.31 
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BE1CHHA1K  PROBLEM  •  6,  STAID ARO  COIDITIOSS 


Constraints : 

gl  »  27 . 0/ (x [0]  *  pos(x[l] ,2)  *  x[2])  -1; 
g2  ■  397 . 6/ (x [0]  *  pos(x[l] ,2)  *  pow(x[2],2))  -1; 
g3  »  1.93  *  pow(x[3] ,3)/(x[l]  *  x[2]  *  pow(x[5] ,4)) ; 
g4  ■  1.93  *  pow(x[4] ,3)/(x[l]  *  x[2]  *  pow(x[6] ,4)) ; 
g6  ■  sqrt(555025.0  *  pow(x[3] ,2)/(pow(x[l] ,2)  * 
pow(x[2] ,2)  ♦  16.9E6)/(0.1  *  pos(x[5],3))  -  1100.0; 
g6  ■  sqrt(555025.0  *  pow(x[4] ,2)/(pow(x[l] ,2)  * 
pow(x[2],2)  +  167 .5E6)/(0. 1  *  pow(x[6] ,3))  -850.0; 
g7  -  x[l]  *  x[2]  -  40; 
g8  »  6  -  x[0]/x[l] ; 
g9  -  x [0] /x [1] -  12; 
g24  »  (1.5  *  x[5]  +  1.9)/x[3]  -  1; 
g26  »  (1.1  *  x[6]  +1.9)/x[4]  -  1; 

Constraints  10  thru  23  handled  by  defining  bounds 
(below)  on  variables 

Objective  Function: 

Bumm  *  (0.7854  *  x[0]  *  x[l]  *  x[l])  *  (3.3333  * 
x[2]  *  x[2]  +  14.9334  *  x[2]  -  43.0934)  -  (1.508 
♦  x[0] )  *  (x[6]  *  x[6]  +  x[6]  *  x[6])  + 

7.477  *  (x[6]  *  x[6]  *  x[5]  +  x[6]  *  x[6]  *  x[6])  + 
0.7854  *  (x[3]  *  x[5]  *  x[6]  +  x[4]  *  x[6]  *  x[6]); 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
QPTIOHS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TQ_GENERATED_RATIO  *  0.0001 
0PTI0NS->C0ST_PRECISI0N  *  le-8 
OPTIO»S->MAIIMUM_CQST_REPEAT  *  2 
0PTI0NS->NUMBER_C0ST_SAMPLES  =  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  *  0 


index_v 

param_minimum  param_maxiunra  paran.  value  par  am. 

.type 

0 

2.6 

3.6 

3.1 

-1 

1 

0.7 

0.8 

0.75 

-1 

2 

17 

28 

22.5 

-1 

3 

7.3 

8.3 

7.8 

-1 

4 

7.3 

8.3 

7.8 

-1 

5 

2.9 

3.9 

3.4 

-1 

6 

5 

5.5 

5.25 

-1 
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Basalts: 

number .generated  3  0,  *nusber .accepted  3  0 


best_generated_8tate->parameter [0]  *  0 
best_generated.state->parameter [1]  3  0 
be8t_generated_Btate->parameter [2]  3  0 
best_generated.8tate->parameter [3]  3  0 
beBt_generated_state->parameter [4]  3  0 
b«8t_gensratad_8tate->parameter [5]  3  0 
be8t_generated_8tate->parameter [6]  3  0 


TOO .MANY. INVALID. STATES  exit.status  3  4 
final.cost  3  best .generated. state->coBt  =  0 
asa.end: time :  Oh  Om  0.74s;  incr:  Oh  Om  O.Ois 

BEST  COST  WITH  MODIFIED  CONDITIONS  2994.31 
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BENCHMARK  PROBLEM  f  7,  MODIFIED  UPPER  BOUVD  (BOO) 


Constraints : 

gl  -  2.4E7  -  x[0]*x[l]*x[l]  ; 
g2  -  1.125ES  -  x[0]*x[l] ; 
g3  -  x[l]  -  2*x[0] ; 

Objective  Function: 
sum  •  x[0]*x[l] 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  »  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0HS->C0ST_PRECISI0N  *  le-8 
OPTIONS->MAIIMUM_COST_REPEAT  »  2 
OPTIONS- > NUMBER. COST .SAMPLES  *  2 
OPTIONS->OSER_INITIAL_PARAMETERS  »  1 
OPTIONS- > ACTIVATE  REANNEAL  -  0 

index _v  param.minimum  param_maximum  param.  value  param.type 
0  0  500  1  -1 

1  0  500  1  -1 

Results : 

number .generated  =  24267,  *number_accepted  =  1000 
best.generated_state->parameter[0]  =  241.9632 

best_generated_state->parameter[l]  *  464.9468 

COST.REPEATING  exit .status  =  3 

final.cost  a  best_generated_state->cost  =  112500 

a8a_end:time:  Oh  Om  10.15s;  incr:  Oh  Om  Os 

BEST  SOLUTION  WITH  MODIFIED  CONDITIONS  112500 
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BENCHMARK  PROBLEM  •  7,  ALTERNATE  OPTIMAL  SOLUTION 


Constraints : 

gl  -  2.4E7  -  x[0]*x[l]*x[l]  ; 
g2  •  1.125E5  -  x[0]*x[l] ; 
g3  -  x[l]  -  2*x  [0] ; 

Objective  Function: 
slum  *  x[0]  *x[l] 

Initial  Conditions: 

OPTIOHS->LIMIT_ACCEPTAHCES  *  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  *  1000 
OPTIONS->ACCEPTED_TO_GENERATED .RATIO  -  0.0001 
0PTI0NS->C0ST_PRECISI0H  *  le-8 
OPTIONS->MAIIMOM_COST_REPEAT  *  2 
0 PTI ONS -> NUMBER. CO ST _ SAMPLES  =  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTICsl->ACTIVATE  REANNEAL  »  0 

index. v  param.min  •  jnun  param.maximum  par  am.  value  param.type 
0  0  500  100  -1 

1  0  500  100  -1 

Results : 

number.generated  *  25161,  ^number .accepted  =  1000 
best_generated_state->parameter[0]  =  307.3117 

best_generated_state->parameter [1]  =  366.0421 

COST.REPEATING  exit.status  =  3 

final.cost  =  best_generated_state->cost  3  112500 

a8a_end:time:  Oh  Om  10.24s;  incr:  Oh  Om  0.01s 

BEST  SOLUTION  WITH  MODIFIED  CONDITIONS  112500 
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BENCHMARK  PROBLEM  *  8,  MODIFIED  UPPER  BOUND 


Constraints : 

gl  *  125.0  -  x[0] ; 

g2  *  100.0  -  x[l] ; 


Objective  Function: 

snnm  =  50  *  x[0]  +  40  *  x[l]  ; 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_INVALID.GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0NS->C0ST_PRECISI0N  *  le-8 
OPTIONS->MAIIMUM_COST_REPEAT  =  2 
0PTI0NS->NUMBER_C0ST_SAMPLES  =  2 
0PTI0NS->USER_INITIAL_PAR1METERS  *  1 
QPTIQNS->ACTIVATE_REANNEAL  =  0 


index.v  param.minimum  param.maximum  param_ value  param_type 
0  0  500  200  -1 

1  0  500  200  -1 

Results : 

number .generated  =  19248,  *number_accepted  =  1001 
best_generated_state->parameter[0]  =  125 

best_generated_state->parameter[l]  =  100 

NORMAL.EXIT  exit.status  =  0 

f inal.cost  =  best_generated_state->cost  =  10250 
a8a_end:time:  Oh  Om  10.43s;  incr:  Oh  Om  Os 

BEST  SOLUTION  WITH  MODIFIED  CONDITIONS  10250 
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BENCHMARK  PROBLEM  #  9.  STANDARD  CONDITIONS 


Constraint : 

gl  «  x[0]  +  2  *  x[l]  -  2; 

Objective  Function: 

sumi  »  (x[0]  -  l)*(x[0]  -  1)  +  <x[l]  -  l)*(x[l]  -  1)  ; 


Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  -  1000 
OPTIONS->LIMIT_INVALID_GENERATED.STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED .RATIO  -  0.0001 
0PTI0NS->C0ST_PRECISI0N  =  le-8 
OPTIONS- > MAIIMUM. COST. REPEAT  »  2 
OPTIONS->NUMBER_COST_SAMPLES  »  2 
OPTIONS->USER_INITIAL_PARAMETERS  *  1 
OPTIONS->ACTI?ATE_REANNEAL  =  0 


index.v  param.mininmin  par am_max imnm  param. value  param.type 
0  0  20  1  -1 

1  0  20  1  -1 

Results : 

number.generated  =  5022,  *immber .accepted  =  1001 
best_generated_state->parameter[0]  -  0.829913 

best_generated_8tate->pazameterCl]  =  0.5850434 


NORMAL.EXIT  exit.status  =  0 

final.cost  =  best_generated_state->cost  =  0.2011185 
a8a.end:time:  Oh  Om  2.56s;  incr:  Oh  Om  0.0s 

BEST  COST  WITH  MODIFIED  CONDITIONS  0.2004642 
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BENCHMARK  PROBLEM  #10,  STANDARD  CONDITIONS 


Constraints : 

gl  ■  xCO]  +  x[l]  -  5; 

Ob j active  Function: 

sums  «  (x[0]  -  3)  *  Cx[0]  -  3)  +  (x[l]  -  3)  *  (x[l]  -  3)  ; 


Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  *  0.0001 
0PTI0NS->C0ST_PRECISI0N  -  la-8 
OPTIONS->MAIIMUM_COST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  *  2 
OPTIOMS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 


index.v  param.minimum  paramjnaximum  param.value  param_type 
0  0  20  1  -1 

1  0  20  1  -1 

Results : 

★number .generated  =  4152,  ★number.accepted  a  1001 
best_generated_state->parameter [0]  =  2.642822 

best_generated_state->parameter [1]  =  2.357178 

NORMAL.EIIT  exit.status  a  0 

final. cost  =  best_generated_state->cost  =  0.5407964 
a8a_end:tima:  Oh  Om  2.1s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  CONDITIONS  0.5026903 
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BEHCHMARK  PROBLEM  «  11,  STANDARD  CONDITIONS 


Constraint : 

gl  ■  x[0]  +  x[l]  -  4; 

Ob j active  Function: 

Siam  ■  Cx[0]  -  i)  *  (x[0]  -  1)  + 

<x[l]  -  1)  *  Cx[l3  -  1)  -  2  *  x[l]  +  2.0  ; 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  *  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0NS->C0ST_PRECISI0N  *  le-8 
OPTIDNS->MAIIMUM_COST_REPEAT  =  2 
OPTIONS- > NUMBER. COST. SAMPLES  =  2 
OPTIONS->DSER_INITIAL_PARAMETERS  =  1 
OPTIONS- >ACTIVATE_REANNEAL  =  0 


index _v  param_ minimum  par am_ max imniri  paxam. value  param.type 
0  0  20  1  -1 

1  0  20  1  -1 

Results : 

number .generated  =  1711,  *number_accepted  =  700 
best_generated_state->parameter[0]  *  1.000001 

best_generated_state->parameterCl]  =  2 


COST .REPEATING  exit .status  =  3 
final_C08t  =  best_generated_state->cost  =  -1 
asa.end: time :  Ob  Om  0.66s;  incr:  Ob  Om  0.01s 

BEST  COST  WITH  MODIFIED  CONDITIONS  -1.0 
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'V- 


BENCHMARK  PROBLEM  •  12,  ST1XDARD  CONDITIONS 
Constraints : 

gl  ■  10  -  (x[0]  +  x[l]) ; 
g2  »  8  -  (x[l]  +  2  *  x [2] ) ; 

Objective  Function: 

sums  ■  (x[0]  *  x[0] )  +  (x[l]  *  x[i])  +  (x[2]  *  x[2]); 

Initial  Conditons: 

OPTIOHS->LIMIT_ACCEPTANCES  *  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  *  1000 
OPTIONS->ACCEPTEDjrO_GENERATED_RATIO  =  0.0001 
0PTI0HS->C0ST_PRECISI0N  *  le-8 
OPTIONS->MAIIMUM_COST_REPEAT  =  2 
OPTIONS->NOMBER_COST_SAMPLES  =  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 

index,  v  param_minimum  param.maxiinum 
0  0  20 

10  20 
2  0  20 

Results : 

number .generated  =  4624,  *number_accepted  =  1001 
best_generated_state->parameter[0]  =  5.74947 

best_generated_8tate->parameter[l]  =  4.25053 

best_generated_state->parameter[2]  =  1.874735 

NORMAL.EXIT  exit.status  =  0 
final. cost  =  best_generated_state->cost  =  54.63804 
asa.endztime:  Oh  Om  2.92s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  CONDITIONS  53.41885 


param.value  param.type 
1  -1 

1  -1 

1  -1 
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BENCHMARK  PROBLEM  •  13,  STANDARD  CONDITIONS 


Constraint : 
x[l]  *  4  -  x[0]  ; 

Objective  Function  in  terns  of  r[0]  only: 

sonm  »  4  *  x[0]  *  x[0]  +  3  *  (4  -  x[0])  *  (4  -  x[0])  - 

6  *  x[0]  *  (4  -  x[0])  -  8  *  x[0]  ; 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_IMVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TQ_GENERATED_RATIQ  =  0.0001 
0PTI0NS->C0ST_PRECISI0N  =  le-8 
OPTIONS- >MAIIMUM_COST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  =  2 
OPTIONS->USER_INITIAL_PARAMETERS  *  1 
OPTIONS- >ACTIVATE_REANNEAL  =  0 


index _v  pamm  minimum  param.maxinmm  param_  value  param_type 
0  0  20  1  -1 


Results : 

number .generated  =  1715,  *number_accepted  =  1001 
best_generated_state->parameter[0]  =  2.166665 

best_generated_8tate->parameter[l]  =  1.833335 

NORMAL.EIIT  exit.status  =  0 

final. cost  ■  best _generated_st at e-> cost  =  -8.333333 
asa_end:time:  Oh  0m  0.61s;  incr:  Oh  Om  0.01s 

BEST  GENERATED  COST  WITH  MODIFIED  CONDITIONS  -8.333333 


BEHCHMARK  PROBLEM  *  14,  STAIDARO  COVDITIOMS 
Constraints : 

gl  -  16/(x[0]  *  x[0])  +  16/(x[l]  *  x[l])  -  1; 
g2  «  16/(x[l]  *  x[l3)  +  16/ (x [2]  *  x[2] )  -  1; 

Objective  Function: 

sun  *  (x[0]  *  x[0])  +  (x[i]  *  x[l])  +  (x[23  *  x[23); 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  *  1000 
OPTIONS->LIMIT_IMVALID_GENERATED_STATES  *  1000 
OPTIOHS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0HS->C0ST_PRECISI0N  »  le-8 
OPTIONS- >MAIIMUM_COST_REPEAT  *  2 
OPTIONS- >NUMBER_COST_SAMPLES  =  2 
OPTIONS- >USER_INITIAL.PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 


index.v  param_mi n i mnm  param_maximnm  param.  value  param.type 


0  0 

20 

1 

-1 

1  0 

20 

1 

-1 

2  0 

20 

1 

-1 

Results : 

number.generated  = 

4152,  *number.accepted  =  1001 

best .generated. state->parameter [0]  = 

5.777124 

best _generated_Btate->parameter [13  * 

5.543801 

best .generated. state->parameter [23  - 

5.77119 

NORMAL.EXIT  exit.status  =  0 

final_cost  =  best_generated_state->co8t  =  97.48401 
asa_end:tine:  Oh  Om  3.14s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  CONDITIONS  94.16438 


C-30 


BENCHMARK  PROBLEM  #  15,  STANDARD  COHDITIOHS 


Constraints : 

gl  »  1 . O/x [0]  -  1.0; 

g2  •  1.5/(x[l]  +  x[0]/4)  -  1.0; 


Objsctivs  Function: 
sums  *  x[0]  +  2  *  x[l]  ; 

Initial  Conditions: 

OPTIOHS->LIHIT_ACCEPTANCES  =  1000 
OPTIOHS->LIMIT_INVALID_GEHERATED_STATES  *  1000 
OPTIONS->ACCEPTED_TO_GENERATRD_RATIO  -  0.0001 
0PTI0NS->C0ST_PRECISI0N  =»  le-8 
0PTI0NS->MAIIMUM_C0ST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  *  2 
OPTIONS->USER_INITIAL_PARAMETERS  *  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 


index.v  paramminiimim  par am.mar imum  param_ value  param_type 
0  0  20  1  -1 

1  0  20  1  -1 

Results : 

number.generated  =  3570,  *number_accepted  =  1001 
best_generated_8tate->parameter[0]  =  2.402833 

best .generated. state->parameter[l]  =  0.8992917 

N0RMAL.EIIT  exit.status  =  0 

final. cost  ■  best_generated_state->cost  *  4.201417 
asa_end:time:  Oh  Om  1.76s;  incr:  Oh  Om  Os 

BEST  COST  WITH  MODIFIED  CONDITIONS  3.50 
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♦ 


BENCHMARK  PROBLEM  •  16,  STANDARD  CONDITIONS 
Constraint! : 

gl  *  (x  [0]  *x  [0]  +  x[0])  +  (x[l]*x[l]  -  x[l])  + 

(x [2] *x [2]  +  x[2])  +  (x [3] *x [3]  -  x[3])  -  8.0  ; 

g2  »  (x  [0]  *x  [0]  -  x[0])  +  2*x[l]  *x[l]  +  x  £2]  *x  [2]  + 
(2*x[3]*x[3]  -  x[3])  -  10.0  ; 

g3  *  <2*x[0]*x[0]  +  2*x[0] )  +  (x[l]+x[l]  -  x[l])  + 
x [2] *x [2]  -  x[3]  -  6.0  ; 

Objective  Function: 

suzra  *  (x[0]*x[0]  -  5*x[0])  +  Cx[l]*x[l]  -  6*x[l])  + 
(2*x [2] *x [2]  -  21*i [2] )  +  (x[3]*x[3]  ♦  7*x[3])  +60.0  ; 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  *  1000 
OPTIONS->LIMIT_IN?ALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  =  0.0001 
0PTI0NS->C0ST_PRECISI0N  -  le-8 
0PTI0NS->MAIIMUM_C0ST_REPEAT  *  2 
OPTIONS->NUMBER_COST_SAMPLES  =  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  «  0 


index_v 

param.minimum  param_inaximu]a  param. value 

param.type 

0 

0 

20  1 

-1 

1 

0 

20  1 

-1 

2 

0 

20  1 

-1 

3 

0 

20  1 

-1 

Results : 

number.generated  =  0,  *number_ accepted  =  0 
best_generated_state->parameter[0]  =  0 

best .generated. state->parameter[l]  =  0 

best_generated_state->parameter[2]  =  0 

best_generated_state->parameter[3]  =  0 

TOO.MANY.INVALID.STATES  exit.status  =  4 
final.cost  =  best_generated_state->cost  =  0 
asa_end:time:  Ob  Om  0.43s;  incr:  Ob  Om  0.0s 

BEST  COST  FOUND  WITH  MODIFIED  CONDITIONS  9.036721 
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BENCHMARK  PROBLEM  *  16.  MODIFIED  BOUNDS  (0.10) 


Constraints : 

gl  *  (x[0]  *x[0]  +  x[0])  +  (x[l]*x[l]  -  x[11)  + 
<x[2]*x[2]  +  x[2] )  +  (x [3] *x [3]  -  x[3])  -  8.0  ; 

g2  ■  (x[0]*x[0]  -  x[0])  +  2*x£l3*x[l]  +  x[2]*x[2]  + 
(2*x [3] *x [3]  -  x[3])  -  10.0  ; 

g3  ■  (2*x[0]*x[0]  +  2*x  [0] )  +  (x[l]*x[l]  -  x[l])  + 
x[2]*xC2]  -  x[3]  -  5.0  ; 

Objective  Function: 

summ  »  (x[0]*x[0]  -  5*x[0])  ♦  (x[l]*x[l]  -  5*x[l])  + 
(2*x C2] *x [2]  -  21*x[2])  +  (x[3]*x[3]  +  7*x[3])  +50.0  ; 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  »  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  a  0.0001 
0PTI0NS->C0ST_PRECISI0N  *  ie-8 
OPTIONS->MAIIMUM_COST_REPEAT  a  2 
OPTIONS->NUMBEH_COST_SAMPLES  a  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  a  0 


index,  v  paranjninimum  param_maxinmm  param_  value  param_type 


0 

1 

2 

3 


0 

0 

0 

0 


10 

1 

-1 

10 

1 

-1 

10 

1 

-1 

10 

1 

-1 

Results : 

number.generated  =  10102,  *number_accepted  =  1001 
best..generated_8tate->parameter[0]  =  0.001839589 

best_generated_8tate->parameter [1]  =  1.037515 

best_generated_state->parameter[2]  =  2.22652 

best..generated_8tate->parameter[3]  =  1.068709e-08 


NORMAL.EXIT  exit.status  *  0 

final.cost  =  best_generated_state->cost  =  9.037529 
asa_end:time:  Oh  Om  8.76s;  incr:  Oh  Om  0.01s 

BEST  COST  FOUND  WITH  MODIFIED  CONDITIONS  9.036721 
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BENCHMARK  PROBLEM  *17,  MODIFIED  BOUNDS  (+,-  0.8  UNITS) 

Constraints : 

gl  ■  0 . 5*sqrt  (x  [0]  )  *x  [6]  /  (x  [2]  *x  [5]  *x  [5]  )  + 

0 . 7*po« (* [0] , 3 . 0) *x [1] *x [5] ♦sqrt (x [6] ) / (x [2] *x [2] )  + 

0.2*x[2]*pow(x[5] ,0.667)*pow(x[6] ,0.25)/(x[l]*sqrt(x[3]))  -  1.0  ; 

g2  »  1 . 3*x [1] *x [6] / (sqrt (x [0] ) *x [2] *x [4] )  + 

0 . 8*x  [2]  *x  [6]  *x  [5]  /  (x  [3]  *x  [4]  )  + 

3.1*sqrt(x[l])*pov(x[5] ,0.333)/(x[0]*x[3]*x[3]*x[4])  -  1.0; 

g3  *  2.0*x[0]*x[4]*pow(x[6] ,0.333)/(pow(x[2] ,1.5)*x[5])  + 

0 . l*x  Cl] *x [4] / (sqrt  (x [2] ) *x [5] *sqrt (x [6] ) )  + 
x  [1]  *sqrt  (x  [2]  )  *x  [4]  /  x  [0]  + 

0 . 65*x [2] *x [4] *x [6] / (x  [1] *x  [1] *x  [5] )  -  1.0; 

g4  *  0.2*x[l]*sqrt(x[4])*pov(x[6] ,0.333)/(xt0]*x[0]*x[3])  + 
0.3*8qrt(x[0])*x[l]*x[l]*x[2]*pow(x[3] ,l/3)*pow(x[6] ,l/4)/pow(x[4] ,2/3)  + 
0.4*x[2]*xC4]*pow(x[6] ,0.75)/(pow(x[0] ,3)*x[l]*x[l])  + 
0.5*xC3]*8qrt(x[6])/(x[2]*x[2])  -  1.0; 

g5  *  10.0*x[0]*x[3]*x[3]*pow(x[6] ,0.125)/(x[l]*pow(x[6]  ,3.0))  + 

15 . 0*x  [2]  *x  [3]  /  (x  [0]  *x  [1]  *x  [1]  *x  [4]  *sqrt  (x  [6]  )  )  + 

20 . 0*x  [1]  *x  [5]  /  (x  [0]  *x  [0]  *x  [3]  *x  [4]  *x  [4]  )  + 

25 . 0*x  [0]  *x  [0]  *x  [1]  *x  [1]  *aqrt  (x  [4]  )  *x  [6]  /  (x  [2]  *x  [5]  *x  [5]  )  -  3000 ; 

g6  =  100.0  - 

(10.0*x[0]*x[3]*x[3]*pow(x[6]  ,0.125)/(x[l]*pow(x[5]  ,3.0))  + 

15 . 0*x  [2]  *x  [3]  /  (x  [0]  *x  [1]  *x  tl]  +x  [4]  *sqrt  (x  [6]  )  )  + 

20 . 0*x  [1]  *x  [5]  /  (x  [0]  *x  [0]  *x  [3]  *x  [4]  *x  [4]  )  + 

25 . 0*x  [0]  *x  [0]  >»x  [1]  *x  [1]  *8qrt  (x  [4]  )  *x  [6]  /  (x  [2]  *x  [5]  *x  [5]  )  )  ; 

Objective  Function: 

Bumm  =  10.0*x[0]*x[3]*x[3]>i,pow(x[6]  ,0.125)/(x[l]*pow(x[5]  ,3.0))  + 

15 . 0*x  [2]  *x  [3]  /  (x  [0]  *x  [1]  *x  [1]  *x  [4]  *sqrt  (x  [6]  )  )  + 

20 . 0*x  [1]  *x  [5]  /  (x  [0]  *x  [0]  *x  [3]  *x  [4]  *x  [4]  )  + 

25 . 0*x  [0]  *x  [0]  *x  [1]  *x  [1]  *8qrt  (x  [4]  )  *x  [6]  /  (x  [2]  *x [5]  *x  [5]  )  ; 
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Initial  Conditions: 

OPTIOMS->LIMIT_ACCEPTANCES  »  1000 
0PTI0NS->LIMIT_INV1LID_GENEBJLTED_STATES  =  1000 
0PTI0MS->ACCRPTED_T0_GENEB1TED_RATI0  =  0.0001 
0PTI0NS->C0ST_PRECISI0N  3  le-08 
OPTIOMS->MAIIMUM_COST_REPEAT  3  2 
OPTIONS- >NUMBER_COST_SANPLES  =  2 
OPTI ONS- >USER_ INITIAL. PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 


index _v  param.minimum  param_maxi mum  param_ value  par am. type 


0 

3 

4.6 

3.873 

-1 

1 

0 

1.6 

0.801 

-1 

2 

1.8 

3.4 

2.616 

-1 

3 

3.4 

5 

4.266 

-1 

4 

0 

1.6 

0.85 

-1 

5 

0.2 

1.8 

1.095 

-1 

6 

0 

0.8 

0.027 

-1 

Results : 

number .generated  3  56185,  *number_accepted  =  1001 
best_generated_state->parameter[0]  =  4.00166 

best. generated. atate->parameter[l]  =  0.5775299 

best_generated_8tate->parameter [2]  =  2.380327 

best_generated_state->parameter[3]  =  3.439459 

best_generated_8tate->parameter[4]  3  0.9862509 

be8t_generated_8tate->parameter [5]  3  1.164156 

be8t.generated_state->parameter [6]  =  0.001627114 

NORHAL.EIIT  exit.status  =  0 

final. cost  =  best_generated_state->cost  =  1042.766 
a8a_end:time:  Oh  8m  30.63s;  incr:  Oh  Om  0.01s 

BEST  COST  WITH  MODIFIED  CONDITIONS  936.8749 
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BEICHMAJLK  PROBLEM  *17.  MODIFIED  BOOEDS  (+,-  0.9  UHITS) 


Constraints : 

gl  ■  0.6*sqrt(x[0])*x[6]/(x[2]*x[5]*x[5])  + 

0.7*pow(x[0]  ,3.0)*x[l]*x[6]*sqrt(x[6])/(x[2]*x[2])  + 

0.2*x[2]*pow(x[5] ,0.667)*pow(x[6] ,0 .25)/(x[l] *sqrt(x[3] ) )  -  1.0  ; 

g2  ■  1 . 3*x [1]  *x [6]  /  (sqrt (x [0]  )  *x  [23  *x  [4]  )  + 

0 . 8*x  [2]  *x  [6]  *x  [5]  /  (x  [3]  *x  [4]  )  + 

3.1*sqrt(x[l])*potf(x[5]  ,0.333)/(x[0]*x[3]*x[3]*x[4])  -  1.0; 

g3  =  2.0*x[0]*x[4]*pow(x[6] ,0.333)/(pou(x[2] ,1.5)*x[6])  ♦ 

0 . l*x [1] *x [4] / (sqrt (x [2] ) *x [6] *sqrt (x [6] ) )  + 
x  [1]  *sqrt  (x  [2]  )  *x  [4]  /  x  [0]  + 

0.66*x[2]*x[4]*x[6]/(x[l]*x[l]*x[5]  )  -  1.0; 

g4  =  0.2*x[l] *sqrt(x[4] )*pow(x[6] ,0.333)/(x[0]*x[0]*x[3])  + 
0.3*sqrt(x[0])*x[l]*x[l]*x[2]*pow(x[3] ,l/3)*pow(x[6] ,l/4)/pow(x[4] ,2/3)  + 
0.4*x[2]*x[4]*pos(x[6]  ,0.75)/(pow(x[0]  ,3)*x[l]*x[l])  + 
0.5*x[3]*sqrt(x[6])/(x[2]*x[2])  -  1.0; 

g5  =  10.0*x[0]*x[3]*x[3]*pou(x[6] ,0.125)/(x[l]*pow(x[S] ,3.0))  + 

15 . 0*x  [2]  *x  [3]  /  (x  [0]  *x  [1]  *x  [1]  *x  [4]  *sqrt  (x  [6]  )  )  + 

20 . 0*x  [1]  *x  [5]  /  (x  [0]  *x  [0]  *x  [3]  *x  [4]  *x  [4]  )  + 

25 . 0*x  [0]  *x  [0]  *x  [1]  *x  [1]  *sqrt  (x  [4]  )  *x  [6]  /  (x  [2]  *x  [5]  *x  [5]  )  -  3000 ; 
g6  a  100.0  - 

(10.0*x[0]+x[3]*x[3]*pow(x[6] ,0 . 125)/(x[l] *pow(x[5] ,3.0))  + 

15 . 0*x  [2]  *x  [3]  /  (x  [0]  *x  [1]  *x  [1]  *x  [4]  *sqrt  (x  [6]  )  )  + 

20 . 0*x  [1]  *x  [5]  /  (x  [0]  *x  [0]  *x  [3]  *x  [4]  *x  [4]  )  + 

25 . 0*x [0]  *x [0]  *x  [1]  *x  [1]  *sqrt  (x  [4] )  *x [6]  /  (x  [2]  *x  [5]  *x  [5]  )  )  ; 

Objective  Function: 

sum  a  10.0*x[0]*x[3]*x[3]*pow(x[6]  ,0. 125)/(x[l]*pow(x[5]  ,3.0))  + 

15 . 0*x  [2]  *x  [3]  /  (x  [0]  *x  [1]  *x  [1]  *x  [4]  *sqrt  (x  [6]  )  )  + 

20 . 0*x  [1]  *x  [5]  /  (x  [0]  *x  [0]  *x  [3]  *x  [4]  *x  [4]  )  + 

25 . 0*x  [0]  *x [0]  *x  [1]  *x  [1]  *8qrt  (x  [4] )  *x  [6]  /  (x  [2]  *x [5]  *x  [5]  )  ; 
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Initial  Conditions: 

OPTIO»S->LIMIT_ACCEPTAXCES  »  1000 
OPTIOIS->LIMIT.IXVALID_GElfmTEO.STATES  =  1000 
OPTIONS- > ACCEPTED _T0 .GENERATED .RATIO  *  0.0001 
OPTIONS->COST_PRECISION  »  l«-08 
OPTIONS->MAIIMUM_COST_REPEAT  *  2 
OPTIONS->NUMBER_COST_SAMPLES  =  2 
OPTIOMS-MJSER.INITIAL.PARAMETERS  =  1 
OPTIONS->ACTIVATE.REANNEAL  »  0 


index _V  pur am  minimum  pa ram  maxi mnm  par am. value  param.type 


0 

2.9 

4.7 

3.873 

-1 

1 

0 

1.7 

0.801 

-1 

2 

1.9 

3.5 

2.616 

-1 

3 

3.3 

5.1 

4.266 

-1 

4 

0 

1.7 

0.85 

-1 

5 

0.1 

1.9 

1.095 

-1 

6 

0 

0.9 

0.027 

-1 

Results : 

number .generated  =  0, 

^number. accepted  =  0 

best .generated. 8tate->parameter[0]  =  0 

best_generated_state->parameter[l]  =  0 

best .generated. state->parameter [2]  =  0 

best .generated. 8tate->parameter [3]  =  0 

be8t_generated_Btate->parameter [4]  =  0 

be8t_generated_8tate->parameter [5]  =  0 

best_generated_8tate->parameter [6]  =  0 

TOO.MAMY.INVALID.STATES  exit.status  =  4 
final.cost  =  best_generated_state->cost  =  0 
asa_end:time:  Oh  0m  1.27s;  incr:  Oh  0m  0.01s 

BEST  COST  WITH  MODIFIED  CONDITIONS  936.8749 
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BENCHMARK  PROBLEM  *18,  MODIPIEO  BOUNDS  (+,-  O.S  UNITS) 


Constraints: 

gl  *  0.0588*x[4] *x[6]  +  0.1*x[0]  -  1.0  ; 

g2  »  0.0688*x[5]*x[7]  +  0.1*x[0]  +  0.1*x[l]  -  1.0; 

g3  *  4.0*x[2]*pos(x[4] ,-1.0)  + 

2.0*pow(x[2] ,-0.71)*pov(x[4] ,-1.0)  + 

0.0S88*x[6]*pov(x[2] ,-1.30)  -  1.0; 

g4  *  4.0*x[3]*pow(x[5] ,-1.0)  + 

2.0*pow(x[3] ,-0.71)*pow(x[5]  ,  -1.0)  + 
0.0588#x[7]*pow(x[3] ,-1.3)  -  1.0; 

g6  *  0.4*pow(x[0] ,0.67)*pov(x[6] ,-0.67)  + 

0.4*pow(x[l] ,0.67)*pow(x[7] ,-0.67)  + 

10.0  -  x[0]  -  x[l]  -  4.2; 

g6  «  0.1  -  (0.4*pow(x[0] ,0.67)*pow(x[6] ,-0.67)  + 
0.4*pow(x[l] ,0.67)*pow(x[7] ,-0.67)  + 

10.0  -  x[0]  -  x[l]); 

Objective  Function: 

stum  *  0.4*pow(x[0] ,0.67)*pow(x[6] ,-0.67)  + 

0.4*pow(x[l] ,0.67)*pow(x[7] ,-0.67)  +  10.0  -  x[0]  -  x[l] ; 


Initial  Conditions: 

OPTIQNS->LIMIT_ACCEPTANCES  =  1000 
OPTIQNS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  *  0.0001 
0PTI0NS->C0ST_PRECISI0N  =  le-8 
OPTIQNS->MAIIMUM_CQST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  =  2 
0PTI0NS->USER_ INITIAL .PARAMETERS  =  1 
OPTIONS- > ACTIVATE.REANNEAL  =  0 
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index.v  parameter  .minimum  parameter  .maximum  param_value  param.type 


0 

6.7 

6.7 

6.226 

-1 

1 

2 

3 

2.582 

-1 

2 

0.1 

1.1 

0.629 

-1 

3 

0.1 

1.1 

0.663 

-1 

4 

6.4 

6.4 

6.994 

-1 

6 

& 

6 

6.541 

-1 

6 

0.6 

1.6 

1.081 

-1 

7 

0 

0.8 

0.381 

-1 

Results : 

number .generated  =  0,  *number_accepted  =  0 
best_generated_Btate->parameter [0]  =  0 

best_generated.state->parameter [1]  =  0 

best .generated. state- >parameter  [2]  =  0 

best_generated_Btate->parameter [3]  =  0 

best_generated_state->parameter [4]  =  0 

best_generated_state->parameter[&]  =  0 

best_generated_8tate->parameter[6]  =  0 

best_generated_state->parameter[7]  0 


T00.M1NY.INVALID.STATES  exit.status  *  4 
final. cost  =  best_generated_state->cost  =  0 
asa_end:time:  Oh  0m  1.16s;  incr:  Oh  Om  0.02s 

BEST  COST  WITH  MODIFIED  PARAMETERS  3.954401 
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BENCHMARK  PROBLEM  *18,  MODIFIED  BOUNDS  (+,-  0.5  UNITS),  AND  OTHERS 


Constraints : 

gl  ■  0.0588*x[4]*x[6]  +  0.1*x[0]  -  1.0  ; 

g2  ■  0.0588*x[5]*x[7]  +  0.1*x[0]  +  0.1*x[i]  -  1.0; 

g3  *  4.0*x[2]*pow(x[4] ,-1.0)  + 

2.0*pow(x[2] ,-0.71)*pow(x[4] ,-1.0)  + 

0 . 0588*x [6] *pow (x [2] , -1 . 30)  -  1.0; 

g4  =>  4.0*x[3]*pow(x[5]  ,-1.0)  + 

2.0*pow(x[3] ,-0.71)*pow(x[5] ,  -1.0)  + 
0.0588*x[7]*pow(x[3] ,-1.3)  -  1.0; 

g5  ■  0.4*pow(x[0] ,0.67)*pow(x[6] ,-0.67)  + 

0.4*pow(x[l] ,0.67)*pow(x[7] ,-0.67)  + 

10.0  -  x[0]  -  x[l]  -  4.2; 

g6  ■  0.1  -  (0.4*pow(x[0] ,0.67)*pow(x[63 ,-0.67)  + 
0.4*pow(x[l] ,0.67)*pow(x[7] ,-0.67)  + 

10.0  -  x[0]  -  x [1] )  ; 

Objective  Function: 

summ  =  0.4*pow(x[0] ,0.67)*pos(x[6] ,-0.67)  + 

0.4*pow(x[l] ,0.67)*pow(x[7] ,-0.67)  +  10.0  -  x[0]  -  x[l]; 


Initial  Conditions: 

OPTIONS- >LIMIT_ ACCEPTANCES  ■  10000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  10000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  *  le-06 
OPTIONS->COST_PRECISION  =  le-18 
OPTIONS->MAIIMUM_COST_REPEAT  *  2 
OPTIONS->NUHBER_COST_SAMPLES  =  5 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS- >ACTIVATE_REANNEAL  *  0 
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index.,  v  parameter_ainimum  parameter  .maximum  pararn. value  param.type 


0 

5.7 

6.7 

6.226 

-1 

1 

2 

3 

2.582 

-1 

2 

0.1 

1.1 

0.629 

-1 

3 

0.1 

1.1 

0.663 

-1 

4 

5.4 

6.4 

5.994 

-1 

6 

5 

6 

5.541 

-1 

6 

0.5 

1.5 

1.081 

-1 

7 

0 

0.8 

0.381 

-1 

Results : 

number .generated  =  170636,  *number_ accepted  =  2236 
best_generated_state->parameter[0]  =  6.27728 

best_generated_8tate->parameter[l]  =  2.455756 

best .generated. state->parameter  [2]  =  0.6727257 

best_generated_state->parameter[3]  =  0.5941369 

best_generated_state->parameter  [4]  =  5.96429 

best_generated_state->parameter[5]  =  5.520324 

best_generated_8tate->parameter[6]  =  1.061509 

be8t_generated_state->parameter[7]  =  0.3903215 

P.TEHP.TOO.SMALL  exit.status  =  1 

final.cost  =  best _generated_state-> cost  =  3.954401 
asa_end:time:  Oh  24m  29.65s;  incr:  Oh  Qm  0.02s 

BEST  COST  WITH  MODIFIED  PARAMETERS  3.954401 
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BENCHMARK  PROBLEM  #19,  STANDARD  CONDITIONS 
Constraints: 

gl  -  2*x[0]  +2*x[l]  +x[9]  +x[10]  -10; 
g2  »  2*x [0]  +2*x[2]  +x[9]  +x[ll]  -10; 
g3  »  2*x[l]  +2*x [2]  +x[10]  +x[ll]  -10; 
g4  »  -8*x [0]  +x [9] ; 
g6  =  -8*x[l]  +x [10] ; 

g6  a  -8*x [2]  +x[ll] ; 

g7  =  -2*x  [3]  -x[4]  -x[9]  ; 

g8  *  -2*x [5]  -x[6]  -x[10] ; 

g9  =  -2*x[7]  -x[8]  +x[ll]  ; 

Objective  Function: 

8nnma5*x[0]+5*x[l]+5*x[2]  + 

5*x  [3]  -5 . 0*  (x  [0]  *x  [0]  +x  [1]  *x  [1]  +x  [2]  *x  [2]  +x  [3]  *x  [3]  ) 
-x  [4]  -x  [5]  -x  [6]  -x  [7]  -x  [8]  -x  [9]  -x  [10]  -x  [11]  -x  [12]  ; 

Initial  Conditions: 

OPTIONS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_INVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED_RATIO  =  le-04 
0PTI0NS->C0ST_PRECISI0N  =  le-8 
OPTIONS->MAIIMUM_COST_REPEAT  =  2 
OPTIONS->NUMBER_COST_SAMPLES  a  2 
OPTIONS->USER_INITIAL_PARAMETERS  =  1 
OPTIONS->ACTIVATE_REANNEAL  =  0 
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index _v  paraa _mi  n i mum  paraffl.maximum  par am. value  param_type 


0 

0 

1 

1 

-1 

1 

0 

1 

1 

-1 

2 

0 

1 

1 

-1 

3 

0 

1 

1 

-1 

4 

0 

1 

1 

-1 

5 

0 

1 

1 

-1 

6 

0 

1 

1 

-1 

7 

0 

1 

1 

-1 

8 

0 

1 

1 

-1 

9 

0 

10 

3 

-1 

10 

0 

10 

3 

-1 

11 

0 

10 

3 

-1 

12 

0 

1 

1 

-1 

Results : 

number .generated  =  13232607,  *number .accepted  =  1001 
beBt_generated_8tate->parameter [0]  -  1 

best_generated_8tate->parameter [1]  -  1 

best. generated. state->parameter [2]  =  1 

best_generated_state->paxameter [3]  =  1 

best_generated_8tate->parameter [4]  *  1 

best_generated_8tate->parameter [5]  a  1 

best .generated. state->parameter [6]  =  1 

best_generated_8tate->parameter[7]  =  1 

best .generated. state->parameter [8]  =  1 

best_generated_8tate->parameter[9]  =  3 

best_generated_8tate->parameterCl0]  =  3 

be8t_generated_state->parameter[ll]  =  3 

best.generated_8tate->parameter[12]  =  1 

NORMAL. EXIT  exit.status  =  0 
final.cost  *  be8t_generated_8tate->co8t  =  -15 


asa_end:time:  lib  57m  12.7s;  incr:  Oh  Om  0.03s 
BEST  COST  WITH  MODIFIED  CONDITIONS  -15 
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BENCHMARK  PROBLEM  *20,  MODIFIED  BOUNDS  (+/-  0.1  UNITS) 


Constraints : 

gl  »  x[0]  +x[l]  +x[2]  +x[3]  +x[4]  +x  [5]  +x[6]  +x[7]  + 
x[8]  +x[9]  +x[10]  +x[ll]  +x[12]  +x[13]  +x[14]  +x[15]  + 
x[16]  +x[17]  +x[18]  +x[19]  +5; 

g2  »  -x[0]  -x[l]  -9*x[2]  +3*x[3]  +5*x[4]  +x[7)  +7*x[8]  - 
-7*x[9]  -4*x[10]  -6*x[ll]  -3*x[12]  +7*x[13]  -5*x[16]  + 
x[16]  +x[17]  +2*x [19]  -2; 

g3  =  2*x[0]  -x[l]  -x  [2]  -9*x[3]  +3*x[4]  +5*x[S]  +x[8]  + 
7*x[9]  -7*x[10]  -4*x[ll]  -6*x [12]  -3+x[13]  +7*x[14]  - 
6*x[16]  +x[17]  +x[18]  +1; 

g4  *  2*x[l]  -x[2]  -x[3]  -9*x[4]  +3*x[S]  +5*x[6]  +x[9]  + 
7*x[10]  -7*x[ll]  -4*x [12]  -6*x[13]  -3*x[14]  +7*x[15]  - 
6*x[17]  +x[18]  +x[19]  +3; 

g5  *  x[0]  +2*x[2]  -x[3]  -x[4]  -9*x[S]  +3*x[6]  +5*x[7)  + 
x[10]  +7*x[ll]  -7*x[12]  -4*x[13]  -6*x[14]  -3*x[16]  + 
7*x[16]  -5*x [18]  +x[19]  -6; 

g6  *  x[0]  +x[l]  +2*x  [3]  -x[4]  -x[5]  -9*x[6]  +3*x[7]  + 
6*x[8]  +x[ll]  +7*x[12]  -7*x[13]  -4*x[14]  -6*x[16]  - 
3*x[16]  +7*x[17]  -6*x[19]  -4; 

g7  =-5*x[0]  +x[l]  +x[2]  +2*x  [4]  -x[5]  -x[6]  -9*x[7]  + 
3*x[8]  +5*x[9]  +x[12]  +7*x[13]  -7*x[14]  -4*x[15]  - 
6*x[16]  -3*x[17]  +7*x[18]  +1; 

g8  =-5*x[l]  +x[2]  +x[3]  +2*x  [5]  -x[6]  -x[7]  -9*x[8]  + 
3*x[9]  +6*x[10]  +x[13]  +7*x[14]  -7*x[15]  -4*x[16)  - 
6*x[17]  -3*x[18]  +7*x[19] ; 

g9  =  7*x[0]  -5*x[2]  +x[3]  +x[4]  +2*x[6]  -x[7]  -x[8]  - 
9*x[9]  +3*x [10]  +5*x[ll]  +x [14]  +7*x[15]  -7*x[16]  - 
4*x[17]  -6*x[18]  -3*x[19]  -9; 

glO— 3*x[0]  +7*x[l]  -5*x[3]  +x[4]  +x[5]  +2*x[7]  -x[8]  - 
x[9]  -9*x[10]  +3*x[ll]  +S*x[12]  +x[15]  +7*x[16]  -7*x[17] 
4*x[18]  -6*x [193-40; 
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Objective  Function: 

suimv-O . 5* ( (x [O] -2) * (x [0] -2) + (x [1] -2) * (x [1] -2) + 

(x [2] -2) * (x [2] -2) + <x  [3] -2) *  <x  [3] -2)  + 

(x  £4]  -2)  *  (x  [4]  -2)  ♦  (x  [5J  -2)  *  (x  [5]  -2) + (x  [6]  -2)  *  (x  [6]  -2)  + 

(x  [7]  -2)  *  (x  [7]  -2)  +  (x  [8]  -2)  *  (x  [8]  -2)  +  (x  [9]  -2)  *  (x  [9]  -2)  + 

(x [10] -2) * (x  [10] -2)  +  (x [1 1] -2) * (x [11] -2) +(x [12] -2) * (x [12]  -2) + 
(x[13]-2>(x[13]-2)+(x[14]-2)*(x[14]-2)+(x[15]-2)*(x[15]-2)+ 
(x  [16]  -2)  *  Cx  [16]  -2) + (x  [17]  -2)  *  (x  [17]  -2) + (x  [18]  -2)  *  (x  [18]  -2)  + 
(x  [19]  -2)  *  (x  [19]  -2)  ) ; 


Initial  Conditions: 

OPTIOMS->LIMIT_ACCEPTANCES  =  1000 
OPTIONS->LIMIT_IHVALID_GENERATED_STATES  =  1000 
OPTIONS->ACCEPTED_TO_GENERATED .RATIO  *  le-04 
OPTIOHS->COST_PRECISION  *  le-8 
QPTIOMS->MAIIMUM_COST_REPEAT  *  2 
OPTIONS->NUMBER_COST_SAMPLES  =  2 
QPTIQNS->USER_INITIAL_PARAMETERS  =  1 
QPTIONS->ACTIVATE_REANNEAL  =  0 


index. v  param_minimiim  paxam_maximnm  param. value  param.type 


0 

0 

0.1 

0 

-1 

1 

0 

0.1 

0 

-1 

2 

28.7 

28.9 

28.8 

-1 

3 

0 

0.1 

0 

-1 

4 

0 

0.1 

0 

-1 

5 

4 

4.2 

4.1 

-1 

6 

0 

0.1 

0 

-1 

7 

0 

0.1 

0 

-1 

8 

0 

0.1 

0 

-1 

9 

0 

0.1 

0 

-1 

10 

0 

0.1 

0 

-1 

11 

0 

0.1 

0 

-1 

12 

0 

0.1 

0 

-1 

13 

0 

0.1 

0 

-1 

14 

0.5 

0.7 

0.6 

-1 

16 

3.9 

4.1 

4 

-1 

16 

0 

0.1 

0 

-1 

17 

2.2 

2.4 

2.3 

-1 

18 

0 

0.1 

0 

-1 

19 

0 

0.1 

0 

-1 
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Results : 

number  .generated  ■  0,  number  .accepted  =  0 
best.generated_state->parameter [0]  *  0 

best_generated_state->paxameter[l]  *  0 

best_generated_state->parameter[2]  *  0 

best.generated_state->parameter[3]  *  0 

best _generated_state->parameter [43  *  0 

best_generated_state->parameter[5]  *  0 

best_generated_state->parameter[6]  =  0 

best_generated_state->parameter[7]  =  0 

best_generated_state->parameter[8]  =  0 

best_generated_state->parameter [9]  =  0 

best_generated_state->parameter[10]  =  0 

best_generated_state->parameter[ll]  =  0 

best_generated_state->parameter[12]  =  0 

best_generated_state->parameter[13]  »  0 

best_generated_state->parameter[14]  =  0 

best_generated_state->parameter[l&3  =  0 

best_generated_state->parameter [16]  =  0 

best_generated_state->parameter[17]  =  0 

best_generated_state->parameter[18]  =  0 

best.generated_state->parameter[19]  =  0 

TOO.MANY.INVALID.STATES  exit.status  =  4 
final. cost  =  best_generated_state->cost  =  0 
asa_end:time:  Ob  0m  2.03s;  incr:  Ob  Om  0.01s 


BEST  COST  WITH  MODIFIED  COHDITIONS  none 
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shows  that  SA  has  limited  applicability  in  structural  optimisation.  Two  primary  factors  were  found 
to  adversely  impact  the  performance  of  the  SA  algorithm  in  these  problems.  These  factors  are  high 
dimensionality,  and  high  levels  of  constraint.  The  difficulty  involved  in  solving  these  problems  with  a 
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was  created  to  quantify  the  combined  effect  of  dimensionality  and  level  of  constraint.  Tins  measure 
can  be  used  to  predict  the  applicability  of  the  SA  algorithm  in  optimising  a  given  system  of  non-linear 
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